Last released Jul 8, 2026
High-performance Byte Pair Encoding (BPE) tokenizer written in modern C++ with Python bindings.
Supported by