Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 22, 2023

• Internal change

  Show description for 8d662b0
  

  Marvin182

  authored and

  copybara-github

  committed
  8d662b0

  Copy full SHA for 8d662b0

Commits on Mar 20, 2023

• Change default lookup batch size to 100.

  Show description for fec19da
  

  Marvin182

  authored and

  copybara-github

  committed
  fec19da

  Copy full SHA for fec19da

• Remove congestion on mutex when creating ArrayRecord readers in TfArrayRecordDatasource.

  Show description for 67d89ed
  

  Marvin182

  authored and

  copybara-github

  committed
  67d89ed

  Copy full SHA for 67d89ed

Commits on Mar 17, 2023

• Remove copy.deepcopy() from OrbaxCheckpointHandler.restore()

  Show description for 887c1f8
  

  Amr Ahmed

  authored and

  copybara-github

  committed
  887c1f8

  Copy full SHA for 887c1f8

Commits on Mar 13, 2023

• Minor fixes.

  Show description for 042c0b7
  

  Marvin182

  authored and

  copybara-github

  committed
  042c0b7

  Copy full SHA for 042c0b7

• Move functionality related to read instructions to separate library.

  Show description for 31e4595
  

  Marvin182

  authored and

  copybara-github

  committed
  31e4595

  Copy full SHA for 31e4595

• Internal change

  Show description for b31c480
  

  Marvin182

  authored and

  copybara-github

  committed
  b31c480

  Copy full SHA for b31c480

• Preserve existing mask in TfBatchWithPadElements.

  Show description for 63dc64c
  

  jpuigcerver

  authored and

  copybara-github

  committed
  63dc64c

  Copy full SHA for 63dc64c

Commits on Mar 11, 2023

• Add get_state() and set_state() to TfGrainDatasetIterator.

  Show description for 9e1b83a
  

  Marvin182

  authored and

  copybara-github

  committed
  9e1b83a

  Copy full SHA for 9e1b83a

Commits on Mar 8, 2023

• Internal change

  Show description for 483df16
  

  Marvin182

  authored and

  copybara-github

  committed
  483df16

  Copy full SHA for 483df16

• Switch to sha1 for hashing file paths in TfArrayRecordDataSource.__repr__().

  Show description for 7f47689
  

  Marvin182

  authored and

  copybara-github

  committed
  7f47689

  Copy full SHA for 7f47689

Commits on Mar 7, 2023

• fix error when dataset contains RaggedTensors

  Show description for 04ad744
  

  Qwlouse

  authored and

  copybara-github

  committed
  04ad744

  Copy full SHA for 04ad744

• Remove deprecated version of CardinalityInternal

  Show description for ad1c4ee
  

  ppwwyyxx

  authored and

  copybara-github

  committed
  ad1c4ee

  Copy full SHA for ad1c4ee

Commits on Mar 6, 2023

• Split up experimental module.

  Show description for 045637e
  

  Marvin182

  authored and

  copybara-github

  committed
  045637e

  Copy full SHA for 045637e

Commits on Mar 2, 2023

• Only store hash of paths when checkpointing TfArrayRecordDataSource.

  Show description for d459903
  

  Marvin182

  authored and

  copybara-github

  committed
  d459903

  Copy full SHA for d459903

Commits on Mar 1, 2023

• Optimize getting read instructions.

  Show description for 1159651
  

  Marvin182

  authored and

  copybara-github

  committed
  1159651

  Copy full SHA for 1159651

Commits on Feb 28, 2023

• Expose experimental in grain.tensorflow

  Show description for b313b46
  

  Grain Team

  authored and

  copybara-github

  committed
  b313b46

  Copy full SHA for b313b46

• Properly parallelize construction of global index for TfArrayRecordDataSource.

  Show description for e74682f
  

  Marvin182

  authored and

  copybara-github

  committed
  e74682f

  Copy full SHA for e74682f

• Expose apply_transformations for use in custom data loaders.

  Show description for 0380d3a
  

  Grain Team

  authored and

  copybara-github

  committed
  0380d3a

  Copy full SHA for 0380d3a

Commits on Feb 27, 2023

• Support tf_data_options in TfMixtureDataLoader.

  Show description for b855ff1
  

  Marvin182

  authored and

  copybara-github

  committed
  b855ff1

  Copy full SHA for b855ff1

• Fix FilterTransform in transformations_per_source in TfMixtureDataLoader.

  Show description for 14bcdde
  

  Marvin182

  authored and

  copybara-github

  committed
  14bcdde

  Copy full SHA for 14bcdde

• Support TfInMemoryDataSource in mixtures.

  Show description for dd0c664
  

  Marvin182

  authored and

  copybara-github

  committed
  dd0c664

  Copy full SHA for dd0c664

• Internal

  Show description for 7e32665
  

  Grain Team

  authored and

  copybara-github

  committed
  7e32665

  Copy full SHA for 7e32665

Commits on Feb 22, 2023

• Adding logging messages for saving and restoring TfGrainDatasetIterator.

  Show description for cb0018c
  

  Marvin182

  authored and

  copybara-github

  committed
  cb0018c

  Copy full SHA for cb0018c

Commits on Feb 21, 2023

• Format Python code

  Show description for b6f071d
  

  Grain Team

  authored and

  copybara-github

  committed
  b6f071d

  Copy full SHA for b6f071d

Commits on Feb 16, 2023

• Add UnsafeTfDataTransform.

  Show description for 44b0057
  

  Marvin182

  authored and

  copybara-github

  committed
  44b0057

  Copy full SHA for 44b0057

• Do not reset iterator at the end.

  Show description for 11ba358
  

  Marvin182

  authored and

  copybara-github

  committed
  11ba358

  Copy full SHA for 11ba358

Commits on Feb 10, 2023

• Add index_shuffle to experimental API.

  Show description for 3bd1fbd
  

  Marvin182

  authored and

  copybara-github

  committed
  3bd1fbd

  Copy full SHA for 3bd1fbd

Commits on Feb 9, 2023

• make test_from_tfds method internal and remove it from the open source release

  Show description for 0350470
  

  Grain Team

  authored and

  copybara-github

  committed
  0350470

  Copy full SHA for 0350470

Commits on Jan 24, 2023

• Expose RECORD constant in the public API and fix minor doc errors.

  Show description for 1d414f0
  

  hamzamerzic

  authored and

  copybara-github

  committed
  1d414f0

  Copy full SHA for 1d414f0

Commits on Jan 23, 2023

• Use at least batch size 1 for fast warmup.

  Show description for 602c7ba
  

  Marvin182

  authored and

  copybara-github

  committed
  602c7ba

  Copy full SHA for 602c7ba

Commits on Jan 19, 2023

• Add global transformation for dropping elements that cause errors in tf.data.Dataset

  Show description for eb79ea2
  

  Grain Team

  authored and

  copybara-github

  committed
  eb79ea2

  Copy full SHA for eb79ea2

Commits on Jan 16, 2023

• Internal change

  Show description for 1023410
  

  Grain Team

  authored and

  Marvin182

  committed
  1023410

  Copy full SHA for 1023410

Commits on Aug 24, 2022

• Internal change

  Show description for 751bf3e
  

  Grain Team

  authored and

  Marvin182

  committed
  751bf3e

  Copy full SHA for 751bf3e

Commits on Aug 5, 2022

• Internal change

  Show description for 707eef0
  

  Grain Team

  authored and

  Marvin182

  committed
  707eef0

  Copy full SHA for 707eef0