Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Dec 17, 2024

• [Device]Support npu (#6159)

  Show description for aaafb38
  

  flybird11111

  and

  pre-commit-ci[bot]

  authored
  aaafb38

  Copy full SHA for aaafb38

Commits on Oct 24, 2024

• [extension] hotfix compile check (#6099)

  ver217

  authored
  80a8ca9

  Copy full SHA for 80a8ca9

Commits on Aug 16, 2024

• [Feature] Zigzag Ring attention (#5905)

  Show description for f5c84af
  

  Edenzzzz

  and

  pre-commit-ci[bot]

  authored
  f5c84af

  Copy full SHA for f5c84af

Commits on Jul 1, 2024

• [pre-commit.ci] pre-commit autoupdate (#5572)

  Show description for 7c2f79f
  pre-commit-ci[bot]

  authored
  7c2f79f

  Copy full SHA for 7c2f79f

Commits on Jun 6, 2024

• [install]fix setup (#5786)

  Show description for a1e39f4
  

  flybird11111

  and

  pre-commit-ci[bot]

  authored
  a1e39f4

  Copy full SHA for a1e39f4

Commits on Jun 5, 2024

• Allow building cuda extension without a device. (#5535)

  Show description for c46e097
  ccoulombe

  authored
  c46e097

  Copy full SHA for c46e097

Commits on May 14, 2024

• [Inference] Delete duplicated copy_vector (#5716)

  Courtesy-Xs

  authored
  121d7ad

  Copy full SHA for 121d7ad

• add paged-attetionv2: support seq length split across thread block (#5707)

  SunflowerAries

  authored
  7806842

  Copy full SHA for 7806842

Commits on May 10, 2024

• [Inference/Feat] Add convert_fp8 op for fp8 test in the future (#5706)

  Show description for 50104ab
  Courtesy-Xs

  authored
  50104ab

  Copy full SHA for 50104ab

Commits on May 6, 2024

• [Inference/Feat] Add quant kvcache support for decode_kv_cache_memcpy (#5686)

  Courtesy-Xs

  authored
  1ace106

  Copy full SHA for 1ace106

• [Inference] Remove unnecessary float4_ and rename float8_ to float8 (#5679)

  SunflowerAries

  authored
  725fbd2

  Copy full SHA for 725fbd2

Commits on Apr 30, 2024

• [Inference] Fix quant bits order (#5681)

  Courtesy-Xs

  authored
  9df016f

  Copy full SHA for 9df016f

• [Inference/Feat] Add kvcache quant support for fused_rotary_embedding_cache_copy (#5680)

  Courtesy-Xs

  authored
  ef8e4ff

  Copy full SHA for ef8e4ff

• [Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663)

  Show description for 5cd75ce
  SunflowerAries

  authored
  5cd75ce

  Copy full SHA for 5cd75ce

• [Inference/Feat] Feat quant kvcache step2 (#5674)

  Courtesy-Xs

  authored
  808ee6e

  Copy full SHA for 808ee6e

Commits on Apr 26, 2024

• [Inference/Feat] Add kvcache quantization support for FlashDecoding (#5656)

  Courtesy-Xs

  authored
  8ccb671

  Copy full SHA for 8ccb671

Commits on Apr 25, 2024

• [Inference/Kernel] Optimize paged attention: Refactor key cache layout (#5643)

  Show description for a8fd3b0
  

  SunflowerAries

  and

  pre-commit-ci[bot]

  authored
  a8fd3b0

  Copy full SHA for a8fd3b0

Commits on Apr 24, 2024

• [Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613)

  Show description for 279300d
  Courtesy-Xs

  authored
  279300d

  Copy full SHA for 279300d

Commits on Apr 23, 2024

• [Fix/Inference]Fix CUDA Rotary Rmbedding GQA (#5623)

  Show description for 12f10d5
  isky-cd

  authored
  12f10d5

  Copy full SHA for 12f10d5

Commits on Apr 19, 2024

• feat baichuan2 rmsnorm whose hidden size equals to 5120 (#5611)

  SunflowerAries

  authored
  ccf7279

  Copy full SHA for ccf7279

Commits on Apr 18, 2024

• [Inference/Kernel] Add Paged Decoding kernel, sequence split within the same thread block (#5531)

  Show description for be396ad
  

  SunflowerAries

  and

  pre-commit-ci[bot]

  authored
  be396ad

  Copy full SHA for be396ad

Commits on Apr 15, 2024

• [Inference/Refactor] Delete Duplicated code and refactor vec_copy utils and reduce utils (#5593)

  Show description for d4cb023
  Courtesy-Xs

  authored
  d4cb023

  Copy full SHA for d4cb023

Commits on Apr 11, 2024

• refactor csrc (#5582)

  Courtesy-Xs

  authored
  a219123

  Copy full SHA for a219123

Commits on Apr 8, 2024

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for d788175
  pre-commit-ci[bot]

  committed
  d788175

  Copy full SHA for d788175

• [Fix] resolve conflicts of merging main

  yuanheng-zhao

  committed
  ed5ebd1

  Copy full SHA for ed5ebd1

• [devops] remove post commit ci (#5566)

  Show description for 641b1ee
  

  ver217

  and

  pre-commit-ci[bot]

  authored
  641b1ee

  Copy full SHA for 641b1ee

• add cast and op_functor for cuda build-in types (#5546)

  Courtesy-Xs

  authored
  7ebdf48

  Copy full SHA for 7ebdf48

Commits on Apr 1, 2024

• [Inference] Add Reduce Utils (#5537)

  Show description for a2878e3
  Courtesy-Xs

  authored
  a2878e3

  Copy full SHA for a2878e3

• [Inference/Kernel]Add get_cos_and_sin Kernel (#5528)

  Show description for 04aca9e
  isky-cd

  authored
  04aca9e

  Copy full SHA for 04aca9e

Commits on Mar 28, 2024

• The writing style of tail processing and the logic related to macro definitions have been optimized. (#5519)

  isky-cd

  authored
  934e31a

  Copy full SHA for 934e31a

Commits on Mar 27, 2024

• [shardformer] update colo attention to support custom mask (#5510)

  Show description for 19e1a5c
  ver217

  authored
  19e1a5c

  Copy full SHA for 19e1a5c

Commits on Mar 25, 2024

• [Inference]Support FP16/BF16 Flash Attention 2 And Add high_precision Flag To Rotary Embedding (#5461)

  Show description for 87079cf
  isky-cd

  authored
  87079cf

  Copy full SHA for 87079cf

Commits on Mar 19, 2024

• add vec_type_trait implementation (#5473)

  Courtesy-Xs

  authored
  7ff42cc

  Copy full SHA for 7ff42cc

• refactor vector utils

  Courtesy-Xs

  committed
  48c4f29

  Copy full SHA for 48c4f29

Commits on Mar 15, 2024

• add some comments

  Courtesy-Xs

  committed
  5724b9e

  Copy full SHA for 5724b9e