Thanks to visit codestin.com
Credit goes to github.com

Skip to content

v0.1.1 Bug fixes; documentation

Choose a tag to compare

View all tags
@janpfeifer janpfeifer released this 09 Dec 14:24
· 26 commits to main since this release
v0.1.1
19f877a
  • Fixed URL resolution of non-model repos.
  • Fixed sentencepiece Tokenizer and tokenizer API string methods (using enumer).
  • Added dataset example.
  • Added usage with Rust tokenizer.
  • Improved README.md
  • Added SentencePiece proto support -- to be used in future conversion of SentencePiece models.
  • Improved documentation.
Assets 2
Loading