Last released Nov 7, 2026
TokenSIMD: high-throughput BPE tokenizer (SIMD pretokenizer, parallel encode)