Last released Aug 16, 2025
Advanced tokenizer with support for BPE, WordPiece, and Unigram algorithms
Supported by