Commits

Breadcrumbs

History for

ondevelop

User selector

All users

All time

Commit History

Commits on May 13, 2025

• [infer] get_output and save_output recover input without msg_queue_id (#10574)

  Show description for 47de2c6
  ckl117

  authored
  47de2c6

  Copy full SHA for 47de2c6

Commits on Apr 18, 2025

• [Infra] support dynamic_insert in dynamic run (#10387)

  Show description for f889167
  ckl117

  authored
  f889167

  Copy full SHA for f889167

Commits on Apr 15, 2025

• [Infra] Add custom all reduce (#10375)

  Show description for e48148d
  zhink

  authored
  e48148d

  Copy full SHA for e48148d

Commits on Apr 1, 2025

• [Doc] update lm-serving-cuda124-cudnn9-v2.3 (#10315)

  Show description for 4f578b9
  bukejiyu

  authored
  4f578b9

  Copy full SHA for 4f578b9

Commits on Mar 28, 2025

• [inference]Update doc (#10278)

  Show description for 81d7bac
  bukejiyu

  authored
  81d7bac

  Copy full SHA for 81d7bac

Commits on Mar 25, 2025

• update (#10255)

  bukejiyu

  authored
  b62530e

  Copy full SHA for b62530e

• [Application] Update distill readme (#10260)

  Show description for e44986b
  DrownFish19

  authored
  e44986b

  Copy full SHA for e44986b

Commits on Mar 20, 2025

• Fix typos in multiple files (#10115)

  co63oc

  authored
  3925efc

  Copy full SHA for 3925efc

Commits on Mar 18, 2025

• [Docs] update_docs (#10180)

  freeliuzc

  authored
  d234592

  Copy full SHA for d234592

Commits on Mar 13, 2025

• add_benchmark (#10110)

  Show description for ee3de26
  vivienfanghuagood

  authored
  ee3de26

  Copy full SHA for ee3de26

Commits on Mar 9, 2025

• update doc (#10028)

  bukejiyu

  authored
  a9fd408

  Copy full SHA for a9fd408

Commits on Mar 7, 2025

• update spec docs (#10016)

  freeliuzc

  authored
  3dc05ad

  Copy full SHA for 3dc05ad

Commits on Mar 6, 2025

• update doc (#10014)

  freeliuzc

  authored
  df10f2c

  Copy full SHA for df10f2c

• [inference]add docker doc (#9998)

  Show description for 0a665a0
  

  bukejiyu

  and

  ltd0924

  authored
  0a665a0

  Copy full SHA for 0a665a0

• [Inference] Add deepseek doc (#9964)

  Show description for ed7f01d
  

  4 peopleauthored
  ed7f01d

  Copy full SHA for ed7f01d

Commits on Feb 17, 2025

• [Docs] fix docs for inference and servering (#9877)

  Show description for ac980d3
  ZHUI

  authored
  ac980d3

  Copy full SHA for ac980d3

Commits on Feb 7, 2025

• [Readme] Update mixtral.md (#9829)

  yuanlehome

  authored
  a9d8648

  Copy full SHA for a9d8648

Commits on Jan 6, 2025

• [Docs] Fix (#9746)

  Show description for 4953500
  DrownFish19

  authored
  4953500

  Copy full SHA for 4953500

• Added FLAGS to replace four params and the value can be adjusted for better speedup (#9624)

  Show description for a52035f
  zhink

  authored
  a52035f

  Copy full SHA for a52035f

Commits on Jan 3, 2025

• [Docs] Refactor custom devices. (#9734)

  ZHUI

  authored
  dac27c4

  Copy full SHA for dac27c4

Commits on Dec 26, 2024

• [LLM INFER] cutlass 3.x gemm on sm90 (#9398)

  Show description for 36d5333
  

  3 peopleauthored
  36d5333

  Copy full SHA for 36d5333

Commits on Dec 16, 2024

• [Custom Devices] feat(sdaa): support sdaa backend infer (#9570)

  Show description for 5e1f01f
  thinking-computer

  authored
  5e1f01f

  Copy full SHA for 5e1f01f

Commits on Dec 12, 2024

• [Inference] Fix docs and support llama3.2 (#9613)

  Show description for f1126c1
  yuanlehome

  authored
  f1126c1

  Copy full SHA for f1126c1

Commits on Nov 28, 2024

• Add document for speculative decoding (#9492)

  Show description for 049b0b5
  Wanglongzhi2001

  authored
  049b0b5

  Copy full SHA for 049b0b5

Commits on Nov 26, 2024

• [Inference] use fp8 cuda core gemm kernel when M<=4 (#9423)

  zhink

  authored
  0b4b810

  Copy full SHA for 0b4b810

Commits on Oct 25, 2024

• update llm infer docs (#9314)

  Show description for 81f5ab5
  yuanlehome

  authored
  81f5ab5

  Copy full SHA for 81f5ab5

Commits on Sep 27, 2024

• [LLM_INFER] Support quantized model from bos and fix docs (#9197)

  Show description for 0289118
  

  yuanlehome

  and

  ming1753

  authored
  0289118

  Copy full SHA for 0289118

Commits on Aug 27, 2024

• llm inference docs (#8976)

  Show description for a2f9558
  Sunny-bot1

  authored
  a2f9558

  Copy full SHA for a2f9558

Loading