Commits

Breadcrumbs

History for

ondevelop

User selector

All users

All time

Commit History

Commits on Jun 28, 2024

• [DCU] high performance LLM train and inference for DCU (#8580)

  Show description for 5364d5e
  yuguo-Jack

  authored
  5364d5e

  Copy full SHA for 5364d5e

Commits on Jun 27, 2024

• support llama avx model inference (#8634)

  bukejiyu

  authored
  69e04c0

  Copy full SHA for 69e04c0

Commits on Jun 13, 2024

• [xpu] change xpu setup.py to paddlenlp_ops (#8595)

  Show description for 77a7693
  

  NeroLoh

  and

  neroluo

  authored
  77a7693

  Copy full SHA for 77a7693

Commits on Jun 12, 2024

• [xpu] add xpu custom ops support for llama2-7b (#8515)

  NeroLoh

  authored
  5ba7a94

  Copy full SHA for 5ba7a94

Commits on Jun 5, 2024

• Add RingFlashAttention for context parallel (#8383)

  Show description for 4cb8b6d
  zhangyuqin1998

  authored
  4cb8b6d

  Copy full SHA for 4cb8b6d

Commits on May 23, 2024

• [Ops] RoPE kernel support theta input (#8440)

  Show description for c6f4159
  FlamingoPg

  authored
  c6f4159

  Copy full SHA for c6f4159

Commits on May 20, 2024

• [NPU] support npu llama2-13B export & inference (#8442)

  Show description for 87e4c4f
  ronny1996

  authored
  87e4c4f

  Copy full SHA for 87e4c4f

Commits on May 14, 2024

• delete csrc/generation/reset_need_stop_value.cc (#8413)

  yuanlehome

  authored
  6902c3e

  Copy full SHA for 6902c3e

Commits on Jan 10, 2024

• [LLM] Support block_attention/cachekv quant for llama (#7649)

  Show description for c5d8d5b
  RichardWooSJTU

  authored
  c5d8d5b

  Copy full SHA for c5d8d5b

• delete useless code for write_cache_kv.cu (#7812)

  yuanlehome

  authored
  75e8981

  Copy full SHA for 75e8981

Commits on Dec 27, 2023

• 去掉内部关于tgt_attention_mask的一些修改 (#7696)

  Show description for 57504e7
  zhoutianzi666

  authored
  57504e7

  Copy full SHA for 57504e7

Commits on Dec 22, 2023

• [LLM PDC] merge some llm pdc code into develop (#7694)

  Show description for d6e7160
  JunnYu

  authored
  d6e7160

  Copy full SHA for d6e7160

Commits on Nov 16, 2023

• [LLM] Inference use new executor and remove top_p_sampling custom op (#7432)

  Show description for 0749e96
  

  yuanlehome

  and

  wj-Mcat

  authored
  0749e96

  Copy full SHA for 0749e96

Commits on Nov 15, 2023

• [llm] support GQA in chatglmv2 (#7412)

  Show description for f01da97
  zhoutianzi666

  authored
  f01da97

  Copy full SHA for f01da97

Commits on Nov 13, 2023

• [LLM] Support ptq inference (#7224)

  Show description for e0643cc
  RichardWooSJTU

  authored
  e0643cc

  Copy full SHA for e0643cc

Commits on Sep 12, 2023

• [LLM] support bloom dybatch (#7003)

  Show description for f560733
  xiaoxiaohehe001

  authored
  f560733

  Copy full SHA for f560733

Commits on Sep 10, 2023

• Support Weightonly in LLM Inference (#6799)

  Show description for fa0ea00
  

  MARD1NO

  and

  wj-Mcat

  authored
  fa0ea00

  Copy full SHA for fa0ea00

Commits on Sep 5, 2023

• Add LLM benchmark scripts (#6906)

  Show description for 19a9207
  MARD1NO

  authored
  19a9207

  Copy full SHA for 19a9207

Commits on Aug 22, 2023

• supports llama-dybatch-V1 (#6676)

  Show description for b3b650c
  

  carryyu

  and

  wj-Mcat

  authored
  b3b650c

  Copy full SHA for b3b650c

Loading