Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Tags: javacruft/litellm

Tags

litellm_v1.75.5-dev_memory_fix_2

Toggle litellm_v1.75.5-dev_memory_fix_2's commit message
refactor(http_parsing_utils.py): streamline request body handling and…

… memory management

- Removed the weak reference cache for request bodies and replaced it with direct storage on the request object to prevent memory leaks.
- Implemented immediate garbage collection every 100 requests to manage memory usage effectively.
- Added a cleanup function to explicitly free memory associated with request processing.
- Updated the logic for retrieving and storing parsed request bodies to enhance performance and reliability.

litellm_v1.73.0-dev_memory_fix_2

Toggle litellm_v1.73.0-dev_memory_fix_2's commit message
Add caching for failed deployments due to configuration errors

- Introduced a new cache to track deployments that fail due to configuration issues, preventing repeated retry attempts.
- Implemented logic to skip deployments that have previously failed due to configuration errors.
- Added a method to clear the failed deployments cache, allowing for retries of specific or all failed deployments.

litellm_v1.73.0-dev_memory_fix_1

Toggle litellm_v1.73.0-dev_memory_fix_1's commit message
Implement pass-through route registration and removal to prevent dupl…

…icates and memory leaks

litellm_v1.73.0-dev_memory_fix

Toggle litellm_v1.73.0-dev_memory_fix's commit message
fix memory leak issue

v1.75.5.dev3

Toggle v1.75.5.dev3's commit message
fixes for update_group

litellm_v1.75.5-dev_memory_fix_1

Toggle litellm_v1.75.5-dev_memory_fix_1's commit message
fix

litellm_v1.75.5-dev_memory_fix

Toggle litellm_v1.75.5-dev_memory_fix's commit message
fix

v1.75.5.rc.1

Toggle v1.75.5.rc.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
fix(health_check_helpers.py): set max tokens for wildcard call to 10,…

… fixes calling gpt-5-nano via wildcard on openai (BerriAI#13482)

gpt-5-nano raises errors for max_tokens=1

v1.75.5-stable.rc-draft

Toggle v1.75.5-stable.rc-draft's commit message
bump: version 1.75.4 → 1.75.5

v1.75.4-nightly

Toggle v1.75.4-nightly's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
added mcp guardrails doc in mcp.md (BerriAI#13452)