Description

• Set DEFAULT_READ_TIMEOUT constant to 120 seconds
• Configure BotocoreConfig with read_timeout when no custom config provided
• Add test coverage for default read timeout behavior

In the following link we can see some more re:Posts regarding this timeout issue and the AWS suggested approach.

• https://repost.aws/knowledge-center/bedrock-large-model-read-timeouts

The timeout errors occur when the AWS SDK for Python (Boto3) client queries the LLM but doesn't receive a response within botocore's default read timeout period. To resolve read timeout errors, increase the read timeout or use streaming APIs.

Note: I was not able to reproduce the read timeout when trying with > ~70,000 tokens (as per a comment on the #699 issue). Tried with many different models as well.

Related Issues

#699

Documentation PR

Type of Change

Bug fix

Testing

How have you tested the change? Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

• I ran hatch run prepare

Checklist

• I have read the CONTRIBUTING document
• I have added any necessary tests that prove my fix is effective or my feature works
• I have updated the documentation accordingly
• I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
• My changes generate no new warnings
• Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.