Last released Mar 15, 2026
High-performance C implementation of BPE tokenizer
Last released Feb 23, 2026
Compact, read-only nested dictionary backed by a DAWG-style radix trie
Supported by