Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Dec 2, 2025

• [pre-commit.ci] pre-commit autoupdate (#1966)

  Show description for 5c3b61d
  pre-commit-ci[bot]

  authored
  5c3b61d

  Copy full SHA for 5c3b61d

Commits on Nov 27, 2025

• Add pre-commit and GitHub Actions workflow for it (#1949)

  Show description for 1f20398
  crcrpar

  authored
  1f20398

  Copy full SHA for 1f20398

Commits on Jul 2, 2024

• release gil (#1816)

  Show description for 23c1f86
  crcrpar

  authored
  23c1f86

  Copy full SHA for 23c1f86

Commits on Apr 19, 2024

• Add 2D Fused RoPE (#1784)

  Show description for b5df1cc
  yaox12

  authored
  b5df1cc

  Copy full SHA for b5df1cc

Commits on Jan 12, 2024

• Fused RoPE for `thd` format (#1756)

  Show description for f058162
  yaox12

  authored
  f058162

  Copy full SHA for f058162

Commits on Nov 29, 2023

• [FusedRoPE] Fuse type conversion and cos/sin (#1752)

  Show description for 37d83fc
  yaox12

  authored
  37d83fc

  Copy full SHA for 37d83fc

Commits on Nov 23, 2023

• Avoid `.contiguous()` in fused RoPE (#1751)

  Show description for dc5fa38
  yaox12

  authored
  dc5fa38

  Copy full SHA for dc5fa38

Commits on Nov 16, 2023

• fix a bug in fused rope (#1750)

  Show description for fd4ae7d
  yaox12

  authored
  fd4ae7d

  Copy full SHA for fd4ae7d

Commits on Nov 14, 2023

• A fused `apply_rotary_pos_emb` implementation for Megatron-Core (#1746)

  Show description for 08f7402
  yaox12

  authored
  08f7402

  Copy full SHA for 08f7402

Commits on Mar 7, 2023

• s/maximimize/maximize/ (#1604)

  Show description for be819ea
  EIFY

  authored
  be819ea

  Copy full SHA for be819ea

Commits on Feb 9, 2023

• decrease warnings & remove append_nvcc_threads from setup.py (#1581)

  Show description for 0145d69
  crcrpar

  authored
  0145d69

  Copy full SHA for 0145d69

Commits on Feb 3, 2023

• [fused softmax] integer overflow and non-contiguous memory (#1568)

  Show description for 5c9625c
  cyanguwa

  authored
  5c9625c

  Copy full SHA for 5c9625c

Commits on Jan 19, 2023

• Extend softmax fusion seq length to 16384 (#1558)

  Show description for e1e0531
  yaoyu-33

  authored
  e1e0531

  Copy full SHA for e1e0531

Commits on Nov 22, 2022

• Update megatron fused softmax follow megatron-lm (#1539)

  Show description for abeca58
  yaoyu-33

  authored
  abeca58

  Copy full SHA for abeca58

Commits on Aug 5, 2022

• Add a generic fused softmax (#1440)

  Show description for cd0a1f1
  yidong72

  authored
  cd0a1f1

  Copy full SHA for cd0a1f1

Commits on Aug 4, 2022

• support for full mask in fused softmax kernel + avoiding inplace operation in bwd pass (#1444)

  Show description for 31cbdd1
  kvareddy

  authored
  31cbdd1

  Copy full SHA for 31cbdd1

Commits on Feb 26, 2022

• [transformer] Fuse grad accumulation with wgrad (#1297)

  Show description for ddc0803
  

  crcrpar

  and

  erhoo82

  authored
  ddc0803

  Copy full SHA for ddc0803

Commits on Oct 27, 2021

• Pipeline Model Parallel (#1202)

  Show description for 63d5dd6
  

  3 peopleauthored
  63d5dd6

  Copy full SHA for 63d5dd6

Commits on Oct 2, 2021

• transformer utils (#1181)

  Show description for 365fdc1
  

  5 peopleauthored
  365fdc1

  Copy full SHA for 365fdc1

Loading