Tags: vllm-project/vllm
Tags
Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) Signed-off-by: Huy Do <[email protected]> Co-authored-by: Roger Wang <[email protected]>
[KVConnector] Migrate the LMCache integration code to be vLLM native (#… …25542) Signed-off-by: ApostaC <[email protected]>
Support Anthropic API /v1/messages Endpoint (#22627) Signed-off-by: liuli <[email protected]> Co-authored-by: liuli <[email protected]> Co-authored-by: Cyrus Leung <[email protected]> Co-authored-by: Michael Goin <[email protected]>
[CI Failure] Fix tests with missing TinyLlama-1.1B-Chat-v1.0-FP8-e2e (#… …26816) Signed-off-by: mgoin <[email protected]>
Update CUDA architecture list in build pipeline for 12.9.1 wheels (#2… …6592) Signed-off-by: Will Eaton <[email protected]> Signed-off-by: simon-mo <[email protected]>
[Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#… …26103) Signed-off-by: Tyler Michael Smith <[email protected]> Co-authored-by: Simon Mo <[email protected]> Signed-off-by: simon-mo <[email protected]>
[Deepseek v3.2] Support indexer prefill chunking (#25999) Signed-off-by: Chen Zhang <[email protected]> Signed-off-by: simon-mo <[email protected]>
[BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) Signed-off-by: Lucas Wilkinson <[email protected]> Signed-off-by: simon-mo <[email protected]>
[P/D] NIXL Updates (#25844) Signed-off-by: Sage Moore <[email protected]> Signed-off-by: simon-mo <[email protected]> Signed-off-by: rentianyue-jk <[email protected]> Signed-off-by: Russell Bryant <[email protected]> Signed-off-by: Isotr0py <[email protected]> Signed-off-by: Chenheli Hua <[email protected]> Signed-off-by: mgoin <[email protected]> Signed-off-by: Tyler Michael Smith <[email protected]> Signed-off-by: NickLucche <[email protected]> Signed-off-by: Roger Wang <[email protected]> Signed-off-by: Robert Shaw <[email protected]> Co-authored-by: Sage Moore <[email protected]> Co-authored-by: Russell Bryant <[email protected]> Co-authored-by: rentianyue-jk <[email protected]> Co-authored-by: Isotr0py <[email protected]> Co-authored-by: Chenheli Hua <[email protected]> Co-authored-by: Wentao Ye <[email protected]> Co-authored-by: Michael Goin <[email protected]> Co-authored-by: Tyler Michael Smith <[email protected]> Co-authored-by: Nicolò Lucchesi <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: Robert Shaw <[email protected]> Signed-off-by: simon-mo <[email protected]>
PreviousNext