Commits

Branch selector

 develop

User selector

All users

All time

Commit History

Commits on Nov 2, 2023

• [Fix llm bugs] Add use cache & version check (#7357)

  Show description for 5a50bdd
  w5688414

  authored
  5a50bdd

  Copy full SHA for 5a50bdd

• support pure single-card modeling for auto_parallel (#7348)

  haohongxiang

  authored
  fd52788

  Copy full SHA for fd52788

• freeze gradio version (#7355)

  Show description for 20a6afe
  wtmlon

  authored
  20a6afe

  Copy full SHA for 20a6afe

Commits on Nov 1, 2023

• fix peft load_best_model_at_end & resume from checkpoint (#7360)

  lugimzzz

  authored
  b98b64b

  Copy full SHA for b98b64b

• add parallel seed control (#7347)

  Show description for 849ebff
  zhiqiu

  authored
  849ebff

  Copy full SHA for 849ebff

Commits on Oct 31, 2023

• [Trainer] Support broadcast optimizer in dp group and fix unified checkpoints (#7256)

  Show description for f15ca84
  

  ZHUI

  and

  DesmonDay

  authored
  f15ca84

  Copy full SHA for f15ca84

• Add qwen baichuan ci (#7324)

  Show description for 4fb915b
  

  wtmlon

  and

  wj-Mcat

  authored
  4fb915b

  Copy full SHA for 4fb915b

• [Other]TopPProcess add bfloat16 input (#7337)

  Show description for 0407095
  LokeZhou

  authored
  0407095

  Copy full SHA for 0407095

• [aistudio] add save to aistudio hub (#7338)

  Show description for f0566e8
  lugimzzz

  authored
  f0566e8

  Copy full SHA for f0566e8

• [CI] Add qwen pretrain test (#7330)

  Show description for 0c05adc
  DesmonDay

  authored
  0c05adc

  Copy full SHA for 0c05adc

Commits on Oct 30, 2023

• [LLM] Support fuse_gpt wint8/4. (#7304)

  Show description for 13efd36
  xiaoxiaohehe001

  authored
  13efd36

  Copy full SHA for 13efd36

Commits on Oct 27, 2023

• [quant] add QuantizationConfig (#7314)

  Show description for fe8cdf0
  lugimzzz

  authored
  fe8cdf0

  Copy full SHA for fe8cdf0

• Support Fast PTQ (#7282)

  RachelXu7

  authored
  e7b53f6

  Copy full SHA for e7b53f6

• Optimize qwen model with fused_rope, fused_rms_norm and core_attn recompute (#7307)

  Show description for 02c9885
  DesmonDay

  authored
  02c9885

  Copy full SHA for 02c9885

• [Bug fixes] update inference doc (#7299)

  Show description for bae323a
  wj-Mcat

  authored
  bae323a

  Copy full SHA for bae323a

Commits on Oct 26, 2023

• Support setting allreduce_matmul_grad_overlapping and enable_send_recv_overlap in auto_config (#7297)

  From00

  authored
  770bfac

  Copy full SHA for 770bfac

• [llm benchmark] Add flash attention 2 (#7057)

  Show description for 5d2c290
  w5688414

  authored
  5d2c290

  Copy full SHA for 5d2c290

Commits on Oct 25, 2023

• fix recompute (#7235)

  lugimzzz

  authored
  513f763

  Copy full SHA for 513f763

Commits on Oct 24, 2023

• Support qwen pretrain. (#7275)

  Show description for 60fd6be
  ZHUI

  authored
  60fd6be

  Copy full SHA for 60fd6be

• Modify dist dataloader (#7286)

  DesmonDay

  authored
  4b86006

  Copy full SHA for 4b86006

• Add qwen flash attention (#7289)

  Show description for 5359c0e
  wawltor

  authored
  5359c0e

  Copy full SHA for 5359c0e

• update inference doc (#7296)

  wj-Mcat

  authored
  22d6bd5

  Copy full SHA for 22d6bd5

Commits on Oct 23, 2023

• [llm]fix weight only quantization (#7252)

  Show description for ddb60e5
  lugimzzz

  authored
  ddb60e5

  Copy full SHA for ddb60e5

• [Bug fixes] disable ir_optim under bfloat16 (#7292)

  Show description for 7dd7f17
  wj-Mcat

  authored
  7dd7f17

  Copy full SHA for 7dd7f17

• [New features] update llm docs (#7290)

  Show description for 4476448
  wj-Mcat

  authored
  4476448

  Copy full SHA for 4476448

• readme update 14b (#7291)

  Show description for 639215a
  wtmlon

  authored
  639215a

  Copy full SHA for 639215a

Commits on Oct 20, 2023

• [GPT] Replace reshape with set_dynamic_shape api to set dynamic shape to a tensor (#7281)

  pkuzyc

  authored
  d9f2603

  Copy full SHA for d9f2603

• [Trainer] Polish the setting of dist_strategy. (#7214)

  Show description for e398018
  Xreki

  authored
  e398018

  Copy full SHA for e398018

Commits on Oct 19, 2023

• [LLM] Support chatglm/bloom wint8/4. (#7207)

  Show description for 2f28167
  

  xiaoxiaohehe001

  and

  wj-Mcat

  authored
  2f28167

  Copy full SHA for 2f28167

• [llm]support chatglmv2 in fined FT (#7253)

  Show description for 9db7022
  zhoutianzi666

  authored
  9db7022

  Copy full SHA for 9db7022

• [PIR][Prim] support PIR train (#7276)

  Show description for f9021f8
  cyber-pioneer

  authored
  f9021f8

  Copy full SHA for f9021f8

Commits on Oct 18, 2023

• [Trainer] Add unified checkpoint for hybrid parallel. (#7238)

  ZHUI

  authored
  f9d8e73

  Copy full SHA for f9d8e73

• add docs for chat-template (#7270)

  wj-Mcat

  authored
  d152fdb

  Copy full SHA for d152fdb

• fix error in dropout of hybrid_model (#7269)

  heavyrain-lzy

  authored
  90f44a9

  Copy full SHA for 90f44a9

• update shard tensor for pp (#7167)

  Show description for af0d26a
  zhaoyinglia

  authored
  af0d26a

  Copy full SHA for af0d26a