Last released Aug 20, 2024
This is a multilingual tokenization tool that currently supports for zh/ja/en/ko, and more languages.
Supported by