Skip to content

Tokenizer 1.33.0
Compare
Choose a tag to compare
@guillaumekln guillaumekln released this 29 Aug 12:34
· 30 commits to master since this release
v1.33.0
f22a8a7

New features

  • [Python] Build ARM64 wheels for macOS

Fixes and improvements

  • [CLI] Fix error when the option --segment_alphabet is not set
  • Fix SentencePiece build warning when compiling with Clang
Assets 2
Loading