Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Jun 19, 2026

• server: refactor child --> router communication (#24821)

  Show description for 2b686a9
  ngxson

  authored
  2b686a9

  Copy full SHA for 2b686a9

• server : optimize get_token_probabilities (#24796)

  Show description for 4b48a53
  angt

  authored
  4b48a53

  Copy full SHA for 4b48a53

• server: remove all internal mentions about "webui" (#24817)

  ngxson

  authored
  175147e

  Copy full SHA for 175147e

• server: add --agent arg, remove redundant webui naming compat (#24801)

  Show description for 8c2d6f6
  ngxson

  authored
  8c2d6f6

  Copy full SHA for 8c2d6f6

• spec: support eagle3 for qwen3.5 & 3.6 (#24593)

  Show description for b14e3fb
  

  ruixiang63

  and

  ggerganov

  authored
  b14e3fb

  Copy full SHA for b14e3fb

• server: fix non-bound n_discard value (ctx shifting) (#24786)

  Show description for 159d093
  

  ngxson

  and

  ggerganov

  authored
  159d093

  Copy full SHA for 159d093

• server : consolidate slot selection into get_available_slot (#24755)

  Show description for 80452d6
  ggerganov

  authored
  80452d6

  Copy full SHA for 80452d6

Commits on Jun 18, 2026

• server: add "schema" and validation (#24150)

  Show description for e1efd09
  ngxson

  authored
  e1efd09

  Copy full SHA for e1efd09

• server : add last-5-seconds generation speed display (#24291)

  Show description for 0802307
  

  akx

  and

  ggerganov

  authored
  0802307

  Copy full SHA for 0802307

Commits on Jun 16, 2026

• spec: add spec metrics mean acceptance length and acceptance rate per position (#24536)

  Show description for 635b65a
  

  ruixiang63

  and

  ggerganov

  authored
  635b65a

  Copy full SHA for 635b65a

Commits on Jun 15, 2026

• mtmd : add post-decode callback (#24645)

  Show description for e3cab40
  ggerganov

  authored
  e3cab40

  Copy full SHA for e3cab40

Commits on Jun 13, 2026

• fit : wrap llama_device_memory_data (#24522)

  ggerganov

  authored
  d8a24cc

  Copy full SHA for d8a24cc

Commits on Jun 12, 2026

• mtmd: add batching API (#24384)

  Show description for e37abd6
  ngxson

  authored
  e37abd6

  Copy full SHA for e37abd6

Commits on Jun 11, 2026

• server : skip checkpoints beyond pos_next (#24411)

  Show description for db94854
  

  aldehir

  and

  ggerganov

  authored
  db94854

  Copy full SHA for db94854

Commits on Jun 9, 2026

• server: log prompts to directory (#22031)

  Show description for 1e91256
  

  jacekpoplawski

  and

  ngxson

  authored
  1e91256

  Copy full SHA for 1e91256

• server : do not clear slots without unified KV cache (#24190)

  Show description for 961e9a3
  

  3 peopleauthored
  961e9a3

  Copy full SHA for 961e9a3

Commits on Jun 8, 2026

• mtmd : add video input support (#24269)

  Show description for 8f83d6c
  ngxson

  authored
  8f83d6c

  Copy full SHA for 8f83d6c

Commits on Jun 7, 2026

• llama : add Gemma4 MTP (#23398)

  am17an

  authored
  04eb4c4

  Copy full SHA for 04eb4c4

Commits on Jun 6, 2026

• mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

  Show description for f5c6ae1
  ngxson

  authored
  f5c6ae1

  Copy full SHA for f5c6ae1

Commits on Jun 4, 2026

• server : disable on-device spec checkpoints (#24108)

  ggerganov

  authored
  7c158fb

  Copy full SHA for 7c158fb

• server: avoid unnecessary checkpoint restore when new tokens are present (#24110)

  Show description for 6f3a9f3
  

  Abioy

  and

  ggerganov

  authored
  6f3a9f3

  Copy full SHA for 6f3a9f3

Commits on Jun 3, 2026

• qwen35: use post-norm hidden state for MTP (#24025)

  Show description for 166fe29
  am17an

  authored
  166fe29

  Copy full SHA for 166fe29

Commits on Jun 2, 2026

• server: add SSE ping interval (#24013)

  ngxson

  authored
  60130d1

  Copy full SHA for 60130d1

• server: real-time reasoning interruption via control endpoint (#23971)

  Show description for 354ebac
  

  ServeurpersoCom

  and

  allozaur

  authored
  354ebac

  Copy full SHA for 354ebac

Commits on Jun 1, 2026

• speculative : fix n_outputs_max and remove draft-simple auto-enable (#23988)

  Show description for 5dcb711
  ggerganov

  authored
  5dcb711

  Copy full SHA for 5dcb711

• llama: limit max outputs of `llama_context` (#23861)

  Show description for de6f727
  am17an

  authored
  de6f727

  Copy full SHA for de6f727

Commits on May 29, 2026

• server: in SSE mode, send HTTP headers when slot starts (#23884)

  Show description for 0821c5f
  ngxson

  authored
  0821c5f

  Copy full SHA for 0821c5f

Commits on May 25, 2026

• server: MTP layer kv-cache should respect draft type ctk (#23646)

  am17an

  authored
  6c4cbdc

  Copy full SHA for 6c4cbdc

• server: fix checkpoints creation (#22929)

  Show description for e2ef8fe
  

  4 peopleauthored
  e2ef8fe

  Copy full SHA for e2ef8fe

Commits on May 24, 2026

• server: add margin for draft model for `fit` (#23485)

  am17an

  authored
  83eebe9

  Copy full SHA for 83eebe9

Commits on May 21, 2026

• server: expose prompt token counts in /slots endpoint (#23454)

  Show description for b65bb4b
  ScrewTSW

  authored
  b65bb4b

  Copy full SHA for b65bb4b

• server : free draft/MTP resources on sleep to fix VRAM leak (#23461)

  Show description for 52fb93a
  am17an

  authored
  52fb93a

  Copy full SHA for 52fb93a

Commits on May 20, 2026

• mtmd: fit_params now take into account mmproj (#21489)

  Show description for e2b129e
  ngxson

  authored
  e2b129e

  Copy full SHA for e2b129e

Commits on May 19, 2026

• server-context: guarantee there is at least 1 token to decode (#23280)

  ServeurpersoCom

  authored
  ccee426

  Copy full SHA for ccee426

• server : print graphs reused in slot timings (#23279)

  Show description for 3c81c8d
  ggerganov

  authored
  3c81c8d

  Copy full SHA for 3c81c8d