4 projects
simmpst
Simbolo Multilingual Partial-syllable Tokenizer
simbolo-mpst
Simbolo Multilingual Partial-syllable Tokenizer
stokenizer
Multilingual Partial Syllable Tokenization - A rule-based tokenization method designed to align with linguistic nuances while minimizing False Positive errors.
simbolotokenizer
Multilingual Partial Syllable Tokenization - A rule-based tokenization method designed to align with linguistic nuances while minimizing False Positive errors.