Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Misleading cache behavior #879

@huangy6

Description

@huangy6

Not sure if this is the intended behavior or not, but I had to spend an hour chasing this down when I was expecting my code to make independent generations so I figured I'd mention it in case anyone else ran into this issue

The default value of None for the cache parameter in OpenAIWrapper suggests that caching is disabled by default. (I believe the documentation also suggests that caching has to be explicitly added to be enabled)

However, the default value of LEGACY_DEFAULT_CACHE_SEED for cache_seed in OpenAIWrapper.create() leads cache_client be set by default.

Again, I'm not sure if this is the intended behavior, but either way I think it would be helpful if the documentation were more clear about cache behavior.

Metadata

Metadata

Assignees

Labels

documentationImprovements or additions to documentation

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions