Last released Mar 20, 2025
This is a multilingual tokenization tool that currently supports for zh/ja/en/ko, and more languages.
Supported by