Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Tags: dannykopping/litellm

Tags

v1.80.7-nightly

Toggle v1.80.7-nightly's commit message
fixes docs

v1.80.6-nightly

Toggle v1.80.6-nightly's commit message
test_e2e_batches_files

v1.80.5.dev32

Toggle v1.80.5.dev32's commit message
type the secrets field

v1.80.5.dev2

Toggle v1.80.5.dev2's commit message
bump: version 1.80.5 → 1.80.6

v1.80.5.dev1

Toggle v1.80.5.dev1's commit message
docs fix

v1.80.0-stable.1

Toggle v1.80.0-stable.1's commit message
Non root docker build fix

v1.80.5.rc.2

Toggle v1.80.5.rc.2's commit message
ui new build

v1.80.5.rc.1

Toggle v1.80.5.rc.1's commit message
ui new build

v1.80.5-nightly

Toggle v1.80.5-nightly's commit message
fix ui unit tests fuck this test why is it so flaky

v1.78.5-stable-patch-1

Toggle v1.78.5-stable-patch-1's commit message
fix: prevent memory blowout in LoggingWorker

Previously, tasks were executed sequentially, awaiting each task before
starting the next. With large queues (10k+ tasks), this caused objects to
accumulate in memory, holding references to heavy resources and leading
to memory blowouts.

This update:

1. Introduces a semaphore to allow a configurable number of concurrent tasks,
   improving throughput and preventing queue buildup.
2. Implements a configurable cleaning mechanism for when the queue reaches its
   limit, ensuring tasks are not dropped.