Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Feb 23, 2026

• [Model Runner V2] Remove propose_draft method (#35070)

  Show description for c645e9a
  WoosukKwon

  authored
  c645e9a

  Copy full SHA for c645e9a

• [Model Runner V2][Minor] Remove redundant `do_spec_decode` field (#35039)

  Show description for 944ffb5
  

  njhill

  and

  WoosukKwon

  authored
  944ffb5

  Copy full SHA for 944ffb5

Commits on Feb 22, 2026

• [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049)

  Show description for 2bcf71b
  

  zixi-qi

  and

  houseroad

  authored
  2bcf71b

  Copy full SHA for 2bcf71b

• [Model] Add NVFP4 quantization support for Step3.5-Flash (#34478)

  Show description for b7892a3
  

  3 peopleauthored
  b7892a3

  Copy full SHA for b7892a3

• [Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

  Show description for 682566b
  benchislett

  authored
  682566b

  Copy full SHA for 682566b

• [Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative decode + prefill / decode disagg setup (#34529)

  Show description for b9c2a56
  

  zixi-qi

  and

  houseroad

  authored
  b9c2a56

  Copy full SHA for b9c2a56

• [ROCm][CI] Fix realtime test timeouts caused by aiter JIT compilation delays (#35052)

  Show description for dd8c3a7
  AndreasKaratzas

  authored
  dd8c3a7

  Copy full SHA for dd8c3a7

• [ROCm][CI] Fix flaky embedding chat test by using tolerance-based comparison (#35050)

  Show description for a8a47c1
  AndreasKaratzas

  authored
  a8a47c1

  Copy full SHA for a8a47c1

• [Bugfix] Fix Qwen3/Qwen3.5 Reasoning Parser (#34779)

  Show description for 40f88d8
  ywang96

  authored
  40f88d8

  Copy full SHA for 40f88d8

• [Model Runner V2] Enable CUDA graph for Eagle3 (#35040)

  Show description for 2cbf965
  WoosukKwon

  authored
  2cbf965

  Copy full SHA for 2cbf965

• Fix apply_top_k_top_p_triton called by non-cuda logits Tensor (#35030)

  Show description for 30132cd
  xli

  authored
  30132cd

  Copy full SHA for 30132cd

• [Benchmark] Use `sns.relplot` for plotting (#35027)

  Show description for cbd95a2
  DarkLight1337

  authored
  cbd95a2

  Copy full SHA for cbd95a2

• [New Model] Add ColModernVBERT (#34558)

  Show description for 970861a
  athrael-soju

  authored
  970861a

  Copy full SHA for 970861a

• [CI] Bump mteb version to `mteb[bm25s]>=2, <3` for pooling model unit tests (#34961)

  Show description for d24bdd7
  yewentao256

  authored
  d24bdd7

  Copy full SHA for d24bdd7

• [CI] Stabilizing ROCm amd-ci signal and minor name fix in upstream (#35008)

  Show description for d403c1d
  AndreasKaratzas

  authored
  d403c1d

  Copy full SHA for d403c1d

• [Model Runner V2] Support attention group (#35036)

  Show description for b71fbd0
  WoosukKwon

  authored
  b71fbd0

  Copy full SHA for b71fbd0

• [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900)

  Show description for 74d90b1
  vadiklyutiy

  authored
  74d90b1

  Copy full SHA for 74d90b1

Commits on Feb 21, 2026

• [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029)

  Show description for a4047d4
  WoosukKwon

  authored
  a4047d4

  Copy full SHA for a4047d4

• [CI/Build] Fix gRPC version mismatch (#35013)

  Show description for 965fe45
  DarkLight1337

  authored
  965fe45

  Copy full SHA for 965fe45

• [Frontend] Add automatic language detection for Whisper transcription (#34342)

  Show description for 98b0205
  

  spacecheck

  and

  NickLucche

  authored
  98b0205

  Copy full SHA for 98b0205

• [Bugfix] Gate 256-bit instructions to CUDA 12.9+ (#34791)

  Show description for 272b535
  

  huydhn

  and

  DarkLight1337

  authored
  272b535

  Copy full SHA for 272b535

• [Benchmark] Improve benchmarks (#35012)

  Show description for f74f157
  DarkLight1337

  authored
  f74f157

  Copy full SHA for f74f157

• [Doc] Fix example of eagle3 (#34960)

  Show description for bebfe55
  

  petrpechman

  and

  Petr Pechman

  authored
  bebfe55

  Copy full SHA for bebfe55

• [Core] Minor structured-output related scheduler optimization (#34765)

  Show description for 820d781
  

  njhill

  and

  DarkLight1337

  authored
  820d781

  Copy full SHA for 820d781

• [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896)

  Show description for ab6f348
  

  NickLucche

  and

  DarkLight1337

  authored
  ab6f348

  Copy full SHA for ab6f348

• [ROCm] Enable bitsandbytes quantization support on ROCm (#34688)

  Show description for 8dc8a99
  Abdennacer-Badaoui

  authored
  8dc8a99

  Copy full SHA for 8dc8a99

• [ROCM] Optimize ROCM_AITER_FA spec decode eagle performance (#34541)

  Show description for 2aab2bb
  jennyyyyzhen

  authored
  2aab2bb

  Copy full SHA for 2aab2bb

• [ROCm][CI] Fix spec decode logprobs flakiness and parametrize tree attention backends (#34599)

  Show description for 54254f7
  AndreasKaratzas

  authored
  54254f7

  Copy full SHA for 54254f7

• [ROCm][AITER] Fix aiter paged_attention_v1 decode for sliding window and head_size < 64 (#34570)

  Show description for cf93c1a
  AndreasKaratzas

  authored
  cf93c1a

  Copy full SHA for cf93c1a

• [CI] Fix ColBERT HF comparison tests on AMD CI + refactor (#34567)

  Show description for 89358f0
  AndreasKaratzas

  authored
  89358f0

  Copy full SHA for 89358f0

• [feat] Add per-block extra_keys to KV events (#33304)

  Show description for a0fe7ea
  

  3 peopleauthored
  a0fe7ea

  Copy full SHA for a0fe7ea

• [CI][MCP][Harmony] Heavy refactoring Harmony & MCP response tests and stabilizing with deterministic test infrastructure (#33949)

  Show description for 991d6bf
  AndreasKaratzas

  authored
  991d6bf

  Copy full SHA for 991d6bf

• [Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)

  Show description for 5719a4e
  craftsangjae

  authored
  5719a4e

  Copy full SHA for 5719a4e

• [Realtime] Add Qwen3-ASR realtime streaming support (#34613)

  Show description for 11be2c7
  

  4 peopleauthored
  11be2c7

  Copy full SHA for 11be2c7

• [Kernel] Optimize sample_recovered_tokens_kernel (#34974)

  Show description for 7a5adad
  xyang16

  authored
  7a5adad

  Copy full SHA for 7a5adad