Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Apr 22, 2026

• Automated Code Change

  Show description for 48180c6
  

  AleksMat

  authored and

  SeqIO

  committed
  48180c6

  Copy full SHA for 48180c6

Commits on Jan 14, 2026

• Replace unicode escaped characters in ipynb files

  Show description for db78942
  

  AleksMat

  authored and

  SeqIO

  committed
  db78942

  Copy full SHA for db78942

Commits on Aug 30, 2025

• Make `tensorflow_text` import optional in `seqio/vocabularies.py`.

  Show description for b898b9f
  

  SeqIO Team

  authored and

  SeqIO

  committed
  b898b9f

  Copy full SHA for b898b9f

• Make `tensorflow_text` import optional in `seqio/vocabularies.py`.

  Show description for f6b68cf
  

  KEHANG

  authored and

  SeqIO

  committed
  f6b68cf

  Copy full SHA for f6b68cf

Commits on Aug 28, 2025

• Update `seqio` version and replace `tfds-nightly` with `tensorflow-datasets`

  Show description for fa03a17
  

  kanglant

  authored and

  SeqIO

  committed
  fa03a17

  Copy full SHA for fa03a17

Commits on Aug 11, 2025

• Revert "use tensorflow-text from link (#779)" (#780)

  Show description for 36acf22
  adarob

  authored
  36acf22

  Copy full SHA for 36acf22

• use tensorflow-text from link (#779)

  davidhabboosh1

  authored
  912831f

  Copy full SHA for 912831f

Commits on Mar 24, 2025

• Make sure tf.io.gfile.glob is only executed once in SeqIO's list_shards

  Show description for 4921327
  

  tomvdw

  authored and

  SeqIO

  committed
  4921327

  Copy full SHA for 4921327

Commits on Feb 26, 2025

• Migrate `tf.data.experimental.RandomDataset` to `tf.data.Dataset.random`.

  Show description for bb079d8
  

  yangustc07

  authored and

  SeqIO

  committed
  bb079d8

  Copy full SHA for bb079d8

Commits on Feb 20, 2025

• Explicitly extract the item from the result of `tf.reduce_max()` to avoid getting a `numpy.ndarray` instead of an `int`.

  Show description for f9b84ed
  

  SeqIO Team

  authored and

  SeqIO

  committed
  f9b84ed

  Copy full SHA for f9b84ed

Commits on Feb 12, 2025

• This option allows user of TFExampleDataSource's pass it to its parent FileDataSource's constructor

  Show description for acb8189
  

  SeqIO Team

  authored and

  SeqIO

  committed
  acb8189

  Copy full SHA for acb8189

Commits on Feb 4, 2025

• Fix bug in `seqio.vocabualries.UnigramVocabulary` .

  Show description for 8023ff6
  

  SeqIO Team

  authored and

  SeqIO

  committed
  8023ff6

  Copy full SHA for 8023ff6

Commits on Jan 15, 2025

• Add dummy implementation of the `bos_id` property in `UnigramVocabulary`

  Show description for b26111b
  

  SeqIO Team

  authored and

  SeqIO

  committed
  b26111b

  Copy full SHA for b26111b

Commits on Dec 20, 2024

• Internal change

  Show description for 256819c
  

  tomvdw

  authored and

  SeqIO

  committed
  256819c

  Copy full SHA for 256819c

Commits on Nov 20, 2024

• Internal change

  Show description for 0228d91
  

  tomvdw

  authored and

  SeqIO

  committed
  0228d91

  Copy full SHA for 0228d91

Commits on Oct 30, 2024

• Add functionality to override the decoders in a TFDS data source

  Show description for 358d1c3
  

  tomvdw

  authored and

  SeqIO

  committed
  358d1c3

  Copy full SHA for 358d1c3

Commits on Oct 15, 2024

• Implement eq in SentencePieceModel based on __getstate__

  Show description for 14cbb0c
  

  tomvdw

  authored and

  SeqIO

  committed
  14cbb0c

  Copy full SHA for 14cbb0c

Commits on Sep 26, 2024

• Make error message a bit more helpful and actionable.

  Show description for bbb5ba3
  

  SeqIO Team

  authored and

  SeqIO

  committed
  bbb5ba3

  Copy full SHA for bbb5ba3

Commits on Sep 17, 2024

• Support ragged tensor in seqio.evaluation in calculating the max seq length.

  Show description for 0d6370a
  

  SeqIO Team

  authored and

  SeqIO

  committed
  0d6370a

  Copy full SHA for 0d6370a

Commits on Sep 10, 2024

• Add a read_only option to seqio.TfdsDataSource.

  Show description for 45013cc
  

  tomvdw

  authored and

  SeqIO

  committed
  45013cc

  Copy full SHA for 45013cc

Commits on Sep 4, 2024

• Add a function to easily override a TFDS data dir in an instantiated source

  Show description for a4183b6
  

  tomvdw

  authored and

  SeqIO

  committed
  a4183b6

  Copy full SHA for a4183b6

Commits on Sep 2, 2024

• Cache getting SourceInfo for a class

  Show description for cf8c3e2
  

  tomvdw

  authored and

  SeqIO

  committed
  cf8c3e2

  Copy full SHA for cf8c3e2

Commits on Jul 28, 2024

• [numpy] Fix users of NumPy APIs that are removed in NumPy 2.0.

  Show description for 2a819e8
  

  hawkinsp

  authored and

  SeqIO

  committed
  2a819e8

  Copy full SHA for 2a819e8

Commits on Jul 10, 2024

• Give UnigramVocabulary the option to split/join on the space character in all encode/decode functions.

  Show description for e88bb6c
  

  galenmandrew

  authored and

  SeqIO

  committed
  e88bb6c

  Copy full SHA for e88bb6c

Commits on Jun 14, 2024

• Internal change

  Show description for 568f9c4
  

  tomvdw

  authored and

  SeqIO

  committed
  568f9c4

  Copy full SHA for 568f9c4

• Internal change

  Show description for d7608c3
  

  tomvdw

  authored and

  SeqIO

  committed
  d7608c3

  Copy full SHA for d7608c3

Commits on Jun 12, 2024

• internal change

  Show description for eee8190
  

  aaudiber

  authored and

  SeqIO

  committed
  eee8190

  Copy full SHA for eee8190

Commits on Jun 11, 2024

• Internal change

  Show description for e58a572
  

  tomvdw

  authored and

  SeqIO

  committed
  e58a572

  Copy full SHA for e58a572

Commits on Jun 10, 2024

• Internal change

  Show description for 4486345
  

  tomvdw

  authored and

  SeqIO

  committed
  4486345

  Copy full SHA for 4486345

• Internal change

  Show description for acb6176
  

  tomvdw

  authored and

  SeqIO

  committed
  acb6176

  Copy full SHA for acb6176

Commits on May 30, 2024

• Expose size attribute of PassThroughVocabulary

  Show description for 4e09f56
  

  tomvdw

  authored and

  SeqIO

  committed
  4e09f56

  Copy full SHA for 4e09f56

Commits on May 28, 2024

• Supports `builder_kwargs` in `TfdsDataSource`

  Show description for 9f39c43
  

  jimlinntu

  authored and

  SeqIO

  committed
  9f39c43

  Copy full SHA for 9f39c43

Commits on May 24, 2024

• depend on sentencepiece version that uses newer protobuf

  Show description for 5966127
  

  iansimon

  authored and

  SeqIO

  committed
  5966127

  Copy full SHA for 5966127

• remove dependency on old protobuf

  Show description for 980b832
  

  iansimon

  authored and

  SeqIO

  committed
  980b832

  Copy full SHA for 980b832

Commits on May 16, 2024

• Allow data sources to specify that they can be shuffled without a buffer.

  Show description for e1b6c86
  

  SeqIO Team

  authored and

  SeqIO

  committed
  e1b6c86

  Copy full SHA for e1b6c86