Last released Apr 12, 2026
Fast BPE tokenizer for LLMs — a faster, drop-in compatible reimplementation of tiktoken
Supported by