Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on May 1, 2024

• [Serving] Fix lints (#2258)

  vinx13

  authored
  d206c44

  Copy full SHA for d206c44

• [Serving] Add engine stats for speculative decoding (#2257)

  vinx13

  authored
  eb4d624

  Copy full SHA for eb4d624

• [Eagle] Avoid worker - engine transfer for hidden states (#2256)

  vinx13

  authored
  51391c3

  Copy full SHA for 51391c3

Commits on Apr 30, 2024

• [Tokenizer] Support ByteLevel BPE in tokenizer token table (#2248)

  Ubospica

  authored
  ca7cdcc

  Copy full SHA for ca7cdcc

• [Fix] fix a typo in event_trace_recorder (#2253)

  Show description for 6a43570
  Kevin-XiongC

  authored
  6a43570

  Copy full SHA for 6a43570

• [Serving] Introduce DraftTokenWorkspaceManager (#2250)

  Show description for afde65c
  vinx13

  authored
  afde65c

  Copy full SHA for afde65c

• [Support] Simplify function names in encoding.h (#2251)

  Show description for 2489964
  Ubospica

  authored
  2489964

  Copy full SHA for 2489964

Commits on Apr 29, 2024

• Model Library Delivery (#2139)

  Show description for d3d264d
  Kartik14

  authored
  d3d264d

  Copy full SHA for d3d264d

• [Sampler] FlashInfer sampling func integration (#2224)

  Show description for 3cb2ee8
  MasterJH5574

  authored
  3cb2ee8

  Copy full SHA for 3cb2ee8

• [DOC] Improve Install via environment variable (#2245)

  Show description for 5a26795
  JackWeiw

  authored
  5a26795

  Copy full SHA for 5a26795

Commits on Apr 28, 2024

• [Serving] Share disco sessions among multiple model function tables (#2242)

  vinx13

  authored
  1a8bad0

  Copy full SHA for 1a8bad0

Commits on Apr 27, 2024

• [REFACTOR] Migrate JSONFFIEngine to formal namespace (#2241)

  Show description for 63a3804
  tqchen

  authored
  63a3804

  Copy full SHA for 63a3804

• [Bugfix] layer_norm_eps in GPT2Config should be float (#2240)

  rickzx

  authored
  fd65973

  Copy full SHA for fd65973

• [Serving] Creating EngineConfig from JSON (#2237)

  Show description for 135bcf9
  MasterJH5574

  authored
  135bcf9

  Copy full SHA for 135bcf9

• [Op] Batch Verify: accept proposal when p and q are close enough (#2236)

  Show description for 8e7b38a
  spectrometerHBH

  authored
  8e7b38a

  Copy full SHA for 8e7b38a

• [Op] Top-p cutoff pivot (#2221)

  Show description for 93c560b
  spectrometerHBH

  authored
  93c560b

  Copy full SHA for 93c560b

Commits on Apr 26, 2024

• [Docs] Update deploy/ios#bring-your-own-model-library (#2235)

  Show description for 470a42a
  nobuhiroYamakado

  authored
  470a42a

  Copy full SHA for 470a42a

• Auto updated submodule references

  

  Git bot

  committed
  3139fd7

  Copy full SHA for 3139fd7

• [Pass] Support two-stage softmax (#2220)

  Show description for ff72113
  MasterJH5574

  authored
  ff72113

  Copy full SHA for ff72113

• [Sampler] Fix GPU sampler behavior when batch size is 0 (#2234)

  Show description for 6850529
  MasterJH5574

  authored
  6850529

  Copy full SHA for 6850529

• [JSONFFIEngine] Support generation config in JSONFFIEngine. Default config values to NOT_GIVEN (#2225)

  Show description for 1cdd0f9
  rickzx

  authored
  1cdd0f9

  Copy full SHA for 1cdd0f9

• [Serving] Remove `cli.model_metadata` import from engine base (#2226)

  Show description for fab0dd3
  MasterJH5574

  authored
  fab0dd3

  Copy full SHA for fab0dd3

Commits on Apr 25, 2024

• [Serving] Support RWKV for serving (#2111)

  Show description for 71c7b3c
  celve

  authored
  71c7b3c

  Copy full SHA for 71c7b3c

• [PYTHON][KVCACHE] Enhance the thread limit for opencl (#2216)

  Show description for 85fffee
  krishnaraj36

  authored
  85fffee

  Copy full SHA for 85fffee

• [Android ] Enable OpenCL host pointer usage (#2215)

  Show description for 55b5c00
  srkreddy1238

  authored
  55b5c00

  Copy full SHA for 55b5c00

Commits on Apr 24, 2024

• [Fix] CUDA architecture detection bug fix (#2211)

  Show description for e115dde
  

  mengshyu

  and

  kobeyu

  authored
  e115dde

  Copy full SHA for e115dde

• [Python] Rename LLMEngine to MLCEngine (#2210)

  Show description for 9ec75ee
  MasterJH5574

  authored
  9ec75ee

  Copy full SHA for 9ec75ee

Commits on Apr 23, 2024

• [Sampler] Prob renormalization with top p for spec decoding (#2201)

  Show description for d7c5a6e
  

  MasterJH5574

  and

  vinx13

  authored
  d7c5a6e

  Copy full SHA for d7c5a6e

• [Serving][Spec] Fix normal mode verification for extra draft token (#2206)

  Show description for af8206b
  MasterJH5574

  authored
  af8206b

  Copy full SHA for af8206b

• [Eagle] Make eagle disco compatible (#2197)

  Show description for 0ed4bcb
  vinx13

  authored
  0ed4bcb

  Copy full SHA for 0ed4bcb

• [Sampler] Enable GPU sampler for draft verification (#2198)

  Show description for 651c2a0
  vinx13

  authored
  651c2a0

  Copy full SHA for 651c2a0

• [Serving] Remove mandatory model check in server (#2195)

  Show description for dc3988a
  MasterJH5574

  authored
  dc3988a

  Copy full SHA for dc3988a

• [Serving] Paged Radix Tree for Prefix Caching (#2183)

  Show description for 12647d5
  cyx-6

  authored
  12647d5

  Copy full SHA for 12647d5

Commits on Apr 22, 2024

• [SERVING] Add Conv Template and Function Calling support to JSON FFI (#2190)

  Show description for 253cd0d
  

  Kartik14

  and

  shreygupta2809

  authored
  253cd0d

  Copy full SHA for 253cd0d

• [Docs] Update quick start to mention Llama 3 8B (#2196)

  Show description for 17a2c6a
  EwoutH

  authored
  17a2c6a

  Copy full SHA for 17a2c6a

Pagination

Previous

Next