Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Tags: bcdonadio/litellm

Tags

v1.75.9-nightly

Toggle v1.75.9-nightly's commit message
test_partner_models_httpx_streaming

v1.75.9.dev3

Toggle v1.75.9.dev3's commit message
fixes for Docker IMG

v1.75.5-stable

Toggle v1.75.5-stable's commit message
test: update test

we now return correct token usage on clientside

v1.75.8-nightly

Toggle v1.75.8-nightly's commit message
test: update test

we now return correct token usage on clientside

v1.75.7-nightly

Toggle v1.75.7-nightly's commit message
bump: version 1.75.6 → 1.75.7

v1.75.6-nightly

Toggle v1.75.6-nightly's commit message
bump: version 1.75.5 → 1.75.6

litellm_v1.75.5-dev_memory_fix_2

Toggle litellm_v1.75.5-dev_memory_fix_2's commit message
refactor(http_parsing_utils.py): streamline request body handling and…

… memory management

- Removed the weak reference cache for request bodies and replaced it with direct storage on the request object to prevent memory leaks.
- Implemented immediate garbage collection every 100 requests to manage memory usage effectively.
- Added a cleanup function to explicitly free memory associated with request processing.
- Updated the logic for retrieving and storing parsed request bodies to enhance performance and reliability.

litellm_v1.73.0-dev_memory_fix_2

Toggle litellm_v1.73.0-dev_memory_fix_2's commit message
Add caching for failed deployments due to configuration errors

- Introduced a new cache to track deployments that fail due to configuration issues, preventing repeated retry attempts.
- Implemented logic to skip deployments that have previously failed due to configuration errors.
- Added a method to clear the failed deployments cache, allowing for retries of specific or all failed deployments.

litellm_v1.73.0-dev_memory_fix_1

Toggle litellm_v1.73.0-dev_memory_fix_1's commit message
Implement pass-through route registration and removal to prevent dupl…

…icates and memory leaks

litellm_v1.73.0-dev_memory_fix

Toggle litellm_v1.73.0-dev_memory_fix's commit message
fix memory leak issue