Tags: wreed4/litellm
Tags
build(config.yml): weaken grype check for nightly - python3.13 known … …cve - blocked on chainguard to release a fix Will call this out on release note, but this an upstream python3.13 issue and shouldn't block nightly releases
[Fix]: /v1/messages - return streaming usage statistics when using li… …tellm with bedrock models (BerriAI#11469) * fix: using litellm with claude code bedrock * fix: usage for bedrock with /messages * fix: bedrock_sse_wrapper * tests: test for test_chunk_parser_usage_transformation * test fix
Litellm dev 06 03 2025 p3 (BerriAI#11388) * fix(vertex_ai/common_utils.py): Close BerriAI#11383 * feat(anthropic/batches): transformation.py new transformation config for anthropic batches * feat(anthropic/batches): working token tracking for anthropic batch calls via `/anthropic` passthrough route * fix(anthropic_passthrough_logging_handler.py): ruff check fixes
[Feat] Performance - Don't create 1 task for every hanging request al… …ert (BerriAI#11385) * feat: add async_get_oldest_n_keys in memory cache * fix: add add_request_to_hanging_request_check * test: alerting * feat: v2 hanging request check * fix: HangingRequestData * fix: AlertingHangingRequestCheck * fix: check_for_hanging_requests * fix: use correct metadata location for hanging requests * fix: formatting alert * test hanging request check * fix: add guard flags for background tasks alerting
PreviousNext