Last released Sep 29, 2026
A fast, modular and light-weight BPE tokenizer for NLP research and prototyping.