Pinned Loading

1. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 6.7k 861

2. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 2.1k 288