Last released Mar 13, 2026
A fast, modular and light-weight BPE tokenizer for NLP research and prototyping.
Supported by