Last released Mar 6, 2026
High-performance C++ toolkit for tokenizer training and dataset pre-tokenization.
Supported by