Last released Jun 11, 2026
Token unit pipeline for building low-padding binary token shards from JSONL datasets.
Supported by