Thanks to visit codestin.com
Credit goes to github.com

Skip to content

aws_batch extract-metadata timeout #1359

@RichardScottOZ

Description

@RichardScottOZ

Hi - an aws configuration problem on my end I would think:

However I was wondering if anyone has any insight here?

2024-05-27 23:38:18,585 [INFO] aws_s3.py:59 -- S3 client created - Region: us-west-2
2024-05-27 23:38:20,691 [INFO] aws_batch.py:89 -- AWS Batch client created - Region: us-west-2 - Env: FARGATE_SPOT
READING: books/Calibre Library/
2024-05-27 23:38:21,387 [INFO] aws_s3.py:59 -- S3 client created - Region: us-west-2
['books/Calibre Library/A. P. Klosky/Cold Steel Wardens (22904)/Cold Steel Wardens - A. P. Klosky.pdf', 'books/Calibre Library/A. P. Klosky/Cold Steel Wardens CSW Cover (12-2 (23034)/Cold Steel Wardens CSW Cover (1 - A. P. Klosky.pdf', "books/Calibre Library/A. R. Holmes/T&T - Vaults of K'Horror gm solo a (25119)/T&T - Vaults of K'Horror gm sol - A. R. Holmes.pdf"]
2024-05-27 23:38:30,333 [INFO] config.py:139 -- Lithops v3.3.0 - Python3.10
2024-05-27 23:38:31,088 [INFO] aws_s3.py:59 -- S3 client created - Region: us-west-2
2024-05-27 23:38:33,095 [INFO] aws_batch.py:89 -- AWS Batch client created - Region: us-west-2 - Env: FARGATE_SPOT
2024-05-27 23:38:33,097 [INFO] invokers.py:107 -- ExecutorID a3cd50-1 | JobID M000 - Selected Runtime: book-mentat-runtime-batch:01 - 2048MB
2024-05-27 23:38:33,313 [INFO] invokers.py:115 -- Runtime book-mentat-runtime-batch:01 with 2048MB is not yet deployed
2024-05-27 23:38:33,313 [INFO] aws_batch.py:428 -- Deploying runtime: book-mentat-runtime-batch:01 - Memory: 2048 Timeout: 180
2024-05-27 23:38:34,502 [INFO] aws_batch.py:333 -- Extracting metadata from: book-mentat-runtime-batch:01
Traceback (most recent call last):
  File "/home/richard/book-mentat/src/games/lithops_test_multimap.py", line 105, in <module>
    fexec2.map(process_pdf, plist)
  File "/home/richard/miniconda3/envs/mentat/lib/python3.10/site-packages/lithops/executors.py", line 254, in map
    runtime_meta = self.invoker.select_runtime(job_id, runtime_memory)
  File "/home/richard/miniconda3/envs/mentat/lib/python3.10/site-packages/lithops/invokers.py", line 116, in select_runtime
    runtime_meta = self.compute_handler.deploy_runtime(self.runtime_name, runtime_memory, runtime_timeout)
  File "/home/richard/miniconda3/envs/mentat/lib/python3.10/site-packages/lithops/serverless/serverless.py", line 84, in deploy_runtime
    return self.backend.deploy_runtime(runtime_name, memory, timeout=timeout)
  File "/home/richard/miniconda3/envs/mentat/lib/python3.10/site-packages/lithops/serverless/backends/aws_batch/aws_batch.py", line 433, in deploy_runtime
    runtime_meta = self._generate_runtime_meta(runtime_name, memory)
  File "/home/richard/miniconda3/envs/mentat/lib/python3.10/site-packages/lithops/serverless/backends/aws_batch/aws_batch.py", line 373, in _generate_runtime_meta
    raise Exception('Could not get metadata')
Exception: Could not get metadata

First time using Batch with Lithops - lambda working fine for the same thing.

Thanks very much.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions