Last released Apr 10, 2026
Fast Byte Pair Encoding (BPE) tokenizer with Python bindings powered by PyO3.
Supported by