Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on May 3, 2025

• frombuffer requires a copy

  carbonscott

  committed
  8be4de1

  Copy full SHA for 8be4de1

• use raw data throughout

  carbonscott

  committed
  ba311c7

  Copy full SHA for ba311c7

Commits on May 1, 2025

• add throughput measure for each socket

  carbonscott

  committed
  b7fafb1

  Copy full SHA for b7fafb1

Commits on Apr 30, 2025

• use bar as separator

  carbonscott

  committed
  2007399

  Copy full SHA for 2007399

• use num_workers from user config for sending poison pills

  carbonscott

  committed
  d3c4e2f

  Copy full SHA for d3c4e2f

Commits on Apr 29, 2025

• use shared memory for highest_index

  carbonscott

  committed
  cf04a47

  Copy full SHA for cf04a47

• support shared metrics

  carbonscott

  committed
  e6aaf93

  Copy full SHA for e6aaf93

Commits on Apr 24, 2025

• support single node multiple sockets

  carbonscott

  committed
  a55b4ed

  Copy full SHA for a55b4ed

Commits on Mar 21, 2025

• Support streaming dataset.

  carbonscott

  committed
  3ac6d07

  Copy full SHA for 3ac6d07

• Support user-specified device.

  carbonscott

  committed
  2e99a5d

  Copy full SHA for 2e99a5d

Commits on Feb 20, 2025

• Support hybrid shard

  carbonscott

  committed
  ffedd86

  Copy full SHA for ffedd86

Commits on Feb 19, 2025

• Supprot srun and make it the default

  carbonscott

  committed
  9074431

  Copy full SHA for 9074431

• Make Checkpoint work with DDP

  carbonscott

  committed
  0558e65

  Copy full SHA for 0558e65

• Checkpoint use depends on fsdp use.

  carbonscott

  committed
  c75e334

  Copy full SHA for c75e334

• Rename fsdp to dp to include ddp.

  carbonscott

  committed
  77d70e8

  Copy full SHA for 77d70e8

• Rename

  carbonscott

  committed
  8d1b1c6

  Copy full SHA for 8d1b1c6

Commits on Feb 15, 2025

• Refactor logger code to logger

  carbonscott

  committed
  808c228

  Copy full SHA for 808c228

• Add new utils

  carbonscott

  committed
  3c6f884

  Copy full SHA for 3c6f884

• Refactor the data

  carbonscott

  committed
  ef12e7e

  Copy full SHA for ef12e7e

• Refactor checkpoint codes to utils/checkpoint

  carbonscott

  committed
  9fc5780

  Copy full SHA for 9fc5780

• Refactor checkpoint

  carbonscott

  committed
  fbc73de

  Copy full SHA for fbc73de

• Update fsdp dist.

  carbonscott

  committed
  389e51f

  Copy full SHA for 389e51f

• Add dist

  carbonscott

  committed
  fc67bad

  Copy full SHA for fc67bad

• Add signal

  carbonscott

  committed
  fb9f75d

  Copy full SHA for fb9f75d

Commits on Jan 28, 2025

• Merge pull request #24 from frobnitzem/docs

  Show description for b3893de
  carbonscott

  authored
  b3893de

  Copy full SHA for b3893de

• Added install docs.

  frobnitzem

  committed
  31fe879

  Copy full SHA for 31fe879

Commits on Nov 19, 2024

• Add nersc example.

  carbonscott

  committed
  180d481

  Copy full SHA for 180d481

Commits on Nov 15, 2024

• Update the checkpoint class based on peaknet.

  carbonscott

  committed
  1c498a7

  Copy full SHA for 1c498a7

Commits on Sep 20, 2024

• Handle case where seg size is even larger than total size.

  carbonscott

  committed
  9f57888

  Copy full SHA for 9f57888

Commits on Sep 17, 2024

• Correct var total_images back to total_size.

  carbonscott

  committed
  ff941f7

  Copy full SHA for ff941f7

• Correct var total_size to total_images.

  carbonscott

  committed
  129cd7e

  Copy full SHA for 129cd7e

• Add num_seg property.

  carbonscott

  committed
  60bed1f

  Copy full SHA for 60bed1f

• No need to separate segment management.

  carbonscott

  committed
  d0d7725

  Copy full SHA for d0d7725

• Add transform.

  carbonscott

  committed
  cb50cb6

  Copy full SHA for cb50cb6

• Created a distribtued zarr dataset that leverages segment manager.

  carbonscott

  committed
  3a37755

  Copy full SHA for 3a37755

Pagination

Previous

Next