Last released Dec 19, 2023
Fast bare-bones BPE for modern tokenizer training
Last released May 2, 2023
batch caching decorator
Supported by