Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Nov 28, 2025

• Enable Ruff pre-commit hooks (#1957)

  Show description for 16fadfe
  

  3 peopleauthored
  16fadfe

  Copy full SHA for 16fadfe

Commits on Dec 9, 2022

• change param of list of tensor to tensor for _make_nccl_premul_sum (#1542)

  Show description for 91fcaaf
  crcrpar

  authored
  91fcaaf

  Copy full SHA for 91fcaaf

Commits on Nov 21, 2022

• [contrib] fix `reduce_scatter_tensor` fallouts in DistributedFusedLamb (#1536)

  Show description for c216175
  

  crcrpar

  and

  mikolajblaz

  authored
  c216175

  Copy full SHA for c216175

Commits on Oct 26, 2022

• Use all_gather_into_tensor and reduce_scatter_tensor (#1513)

  Show description for f680fab
  Aidyn-A

  authored
  f680fab

  Copy full SHA for f680fab

Commits on Oct 2, 2022

• Replace usage of internal with public APIs (#1496)

  Show description for 6816ef6
  kumpera

  authored
  6816ef6

  Copy full SHA for 6816ef6

Commits on Aug 25, 2022

• [contrib] Guard for `torch.distributed._make_nccl_premul_sum` (#1465)

  Show description for 7e90f95
  crcrpar

  authored
  7e90f95

  Copy full SHA for 7e90f95

Commits on Jan 31, 2022

• fix group range to compute l2_norm (#1266)

  Show description for a47d1a7
  

  chochowski

  and

  seryilmaz

  authored
  a47d1a7

  Copy full SHA for a47d1a7

Commits on Oct 14, 2021

• change chunking scheme for full-allreduce case, add parameter order argument, both to enable contiguous chunking of allgather (#1190)

  seryilmaz

  authored
  1d5f7e5

  Copy full SHA for 1d5f7e5

• Fix dist lamb (#1185)

  Show description for d9a46fd
  nanz-nv

  authored
  d9a46fd

  Copy full SHA for d9a46fd

Commits on Sep 2, 2021

• option to set param views to flat buffer (#1152)

  Show description for 17eec27
  

  3 peopleauthored
  17eec27

  Copy full SHA for 17eec27

• use prescaling for collective (#1157)

  seryilmaz

  authored
  2e98baa

  Copy full SHA for 2e98baa

• Add full all-reduce code path for DistributedFusedAdam (#1146)

  Show description for 1cb9c5c
  

  kexinyu

  and

  ptrblck

  authored
  1cb9c5c

  Copy full SHA for 1cb9c5c

Commits on Sep 1, 2021

• Seryilmaz/fuse norm into scale (#1149)

  Show description for 4d190db
  

  seryilmaz

  and

  Sukru Eryilmaz

  authored
  4d190db

  Copy full SHA for 4d190db

Commits on Aug 30, 2021

• Wrote a small wrapper function for flat view creation in _lazy_init_stage2 to support channels last data formats

  azrael417

  committed
  333da80

  Copy full SHA for 333da80

Commits on May 26, 2021

• Distributed LAMB: Clip grads before reduce_scatter/all_reduce (#1099)

  Show description for ebcd7f0
  kexinyu

  authored
  ebcd7f0

  Copy full SHA for ebcd7f0

Commits on Apr 15, 2021

• DistributedFusedLAMB: enable no_copy and add barrier for SHARP (#1075)

  Show description for bb79158
  

  kexinyu

  and

  Kexin Yu

  authored
  bb79158

  Copy full SHA for bb79158

Commits on Mar 24, 2021

• sync-free Distributed LAMB + parameter reordering (#1055)

  Show description for a651e2c
  

  kexinyu

  and

  Kexin Yu

  authored
  a651e2c

  Copy full SHA for a651e2c

Commits on Dec 4, 2020

• Distributed LAMB fixes (#1007)

  Show description for 8a80d47
  

  3 peopleauthored
  8a80d47

  Copy full SHA for 8a80d47

Commits on May 31, 2020

• Remove verbose print-out

  thorjohnsen

  committed
  b614a85

  Copy full SHA for b614a85

• Delayed init

  thorjohnsen

  committed
  75f1e9d

  Copy full SHA for 75f1e9d

• Delayed init

  thorjohnsen

  committed
  53cfd8c

  Copy full SHA for 53cfd8c

Commits on May 30, 2020

• Make step global state variable

  thorjohnsen

  committed
  4c54fd2

  Copy full SHA for 4c54fd2

• Make step global state variable

  thorjohnsen

  committed
  5caf95c

  Copy full SHA for 5caf95c

• Bug fix

  thorjohnsen

  committed
  7741808

  Copy full SHA for 7741808

• Add more default values from regular lamb optimizer

  thorjohnsen

  committed
  1245815

  Copy full SHA for 1245815

• Bug fix in update norm calculation

  thorjohnsen

  committed
  1e0aadd

  Copy full SHA for 1e0aadd

• Bug fix in update norm calculation

  thorjohnsen

  committed
  0f64f6a

  Copy full SHA for 0f64f6a

• Bug fix in update norm calculation

  thorjohnsen

  committed
  56650eb

  Copy full SHA for 56650eb

• Bug fix

  thorjohnsen

  committed
  fb2d0f4

  Copy full SHA for fb2d0f4

• Bug fix

  thorjohnsen

  committed
  3c02784

  Copy full SHA for 3c02784

• Bug fix

  thorjohnsen

  committed
  9773218

  Copy full SHA for 9773218

• Add optional accumulation step

  thorjohnsen

  committed
  02fd734

  Copy full SHA for 02fd734

• Bug fix

  thorjohnsen

  committed
  9a09107

  Copy full SHA for 9a09107

• Bug fix

  thorjohnsen

  committed
  ef43735

  Copy full SHA for ef43735

• Bug fix

  thorjohnsen

  committed
  e6925e6

  Copy full SHA for e6925e6