Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Jun 25, 2024

• Adding FSDP Memory Tracking and Estimation

  Show description for 236d2ff
  sanketpurandare

  committed
  236d2ff

  Copy full SHA for 236d2ff

• Improved `repeat_kv` eager perf

  Show description for 4ba94bd
  

  Andrew Gu

  committed
  4ba94bd

  Copy full SHA for 4ba94bd

• Set `record_shapes=True` for profiler

  Show description for abb9e15
  

  Andrew Gu

  committed
  abb9e15

  Copy full SHA for abb9e15

Commits on Jun 21, 2024

• Add train loop support for looped PP schedules

  Show description for ac83f9c
  wconstab

  committed
  ac83f9c

  Copy full SHA for ac83f9c

Commits on Jun 20, 2024

• whole_model for fp8 (#414)

  Show description for c88d0bc
  weifengpy

  authored
  c88d0bc

  Copy full SHA for c88d0bc

Commits on Jun 19, 2024

• dump memory snapshot to analyze OOMs (#395)

  Show description for 8adbfa3
  weifengpy

  authored
  8adbfa3

  Copy full SHA for 8adbfa3

Commits on Jun 18, 2024

• Prepare train.py for model chunks for pipelining

  Show description for 443ead2
  wconstab

  committed
  443ead2

  Copy full SHA for 443ead2

Commits on Jun 17, 2024

• Change debugmodel to have 8 layers

  Show description for 4a1095a
  wconstab

  committed
  4a1095a

  Copy full SHA for 4a1095a

Commits on Jun 14, 2024

• Break down parallelize_llama for inference cases

  Show description for d5b7525
  kwen2501

  committed
  d5b7525

  Copy full SHA for d5b7525

• Cosmetic changes to train.py

  Show description for 3e946a1
  kwen2501

  committed
  3e946a1

  Copy full SHA for 3e946a1

• enable TritonFusedRMSNorm with local_map annotation (#404)

  Show description for d761994
  XilunWu

  authored
  d761994

  Copy full SHA for d761994

Commits on Jun 13, 2024

• SAC API follow ups to restore old behavior (#401)

  Show description for 093ba15
  wanchaol

  authored
  093ba15

  Copy full SHA for 093ba15

• Fix SAC BC breaking and renaming to ac_freq (#397)

  Show description for 33f301d
  wanchaol

  authored
  33f301d

  Copy full SHA for 33f301d

• Update unit_test_cpu.yaml with cpu nightly (#396)

  wanchaol

  authored
  a4cd9ba

  Copy full SHA for a4cd9ba

• enable TP fp8 allgather with PrepareFloat8ModuleInput (#393)

  Show description for e17e3b8
  wanchaol

  authored
  e17e3b8

  Copy full SHA for e17e3b8

Commits on Jun 12, 2024

• update all toml files to use experimental section (#392)

  wanchaol

  authored
  763b810

  Copy full SHA for 763b810

• Update contributing.md (#385)

  Show description for e991ae4
  H-Huang

  authored
  e991ae4

  Copy full SHA for e991ae4

• del logits=(bs, seq_len, vocab_size) to save 3.9G memory (#391)

  Show description for c5d5c1f
  weifengpy

  authored
  c5d5c1f

  Copy full SHA for c5d5c1f

Commits on Jun 11, 2024

• Fix 1D PP tracer test

  Show description for e858ab4
  

  kwen2501

  authored and

  wconstab

  committed
  e858ab4

  Copy full SHA for e858ab4

Commits on Jun 10, 2024

• add the 8-gpu test badge and use correct links for the integration test badges

  Show description for 3bb7bf3
  tianyu-l

  committed
  3bb7bf3

  Copy full SHA for 3bb7bf3

• fix missing tb logs

  Show description for 9700e0f
  tianyu-l

  committed
  9700e0f

  Copy full SHA for 9700e0f

Commits on Jun 9, 2024

• BC fix for ManualPipelineStage import (#388)

  wanchaol

  authored
  6de5d31

  Copy full SHA for 6de5d31

• DeviceMesh BC fix (#387)

  Show description for ccf1ed8
  wanchaol

  authored
  ccf1ed8

  Copy full SHA for ccf1ed8

Commits on Jun 7, 2024

• Abstract out out optimizer params and update foreach calling convention (#386)

  Show description for 104bd6c
  drisspg

  authored
  104bd6c

  Copy full SHA for 104bd6c

Commits on Jun 6, 2024

• [torchtitan] Fix test runner fused optim tests (#384)

  wz337

  authored
  baa678c

  Copy full SHA for baa678c

• [torchtitan][optim] Add fused as an option in train config (#355)

  Show description for 7cf41bb
  wz337

  authored
  7cf41bb

  Copy full SHA for 7cf41bb

Commits on Jun 5, 2024

• Add 3D support

  Show description for 3bc7678
  wconstab

  committed
  3bc7678

  Copy full SHA for 3bc7678

• [RFC] Allow ModelWrapper and OptimizerWrapper to accept multiple models

  Show description for c89aa40
  

  fegin

  authored and

  wconstab

  committed
  c89aa40

  Copy full SHA for c89aa40

Commits on Jun 4, 2024

• Make metrics logging work for pipeline parallelism

  Show description for 0594c04
  wconstab

  committed
  0594c04

  Copy full SHA for 0594c04

Commits on Jun 3, 2024

• Use general way to access and update submodules

  Show description for 3050098
  kwen2501

  committed
  3050098

  Copy full SHA for 3050098

• Fix start/stop layer parsing

  Show description for 8badf7e
  wconstab

  committed
  8badf7e

  Copy full SHA for 8badf7e

• Make seed checkpoint creation work on CPU

  Show description for a0f82d5
  wconstab

  committed
  a0f82d5

  Copy full SHA for a0f82d5

Commits on May 31, 2024

• keep only latest k checkpoints (#366)

  Show description for 54b5fa2
  liangluofb

  authored
  54b5fa2

  Copy full SHA for 54b5fa2

Commits on May 30, 2024

• use integration test as the badge shown on the homepage

  Show description for 07fa503
  tianyu-l

  committed
  07fa503

  Copy full SHA for 07fa503

• Add --test option to specify test to run (#368)

  Show description for 3343d1d
  kwen2501

  authored
  3343d1d

  Copy full SHA for 3343d1d