https://pypi.org/project/silabi-tokenizer/ Recent updates to the Python Package Index for silabi-tokenizer en https://pypi.org/project/silabi-tokenizer/0.5.0/ A custom tokenizer for Swahili text using syllabic vocabulary with byte fallback. nguthiruedwin@gmail.com Mon, 22 Jul 2024 13:51:03 GMT https://pypi.org/project/silabi-tokenizer/0.4.0/ A custom tokenizer for Swahili text using syllabic vocabulary with byte fallback. nguthiruedwin@gmail.com Thu, 11 Jul 2024 14:42:11 GMT https://pypi.org/project/silabi-tokenizer/0.3.0/ A custom tokenizer for Swahili text using syllabic vocabulary with byte fallback. nguthiruedwin@gmail.com Thu, 11 Jul 2024 14:36:12 GMT https://pypi.org/project/silabi-tokenizer/0.2.0/ A custom tokenizer for Swahili text using syllabic vocabulary with byte fallback. nguthiruedwin@gmail.com Thu, 11 Jul 2024 14:00:08 GMT https://pypi.org/project/silabi-tokenizer/0.1.0/ A custom tokenizer for Swahili text using syllabic vocabulary with byte fallback. nguthiruedwin@gmail.com Thu, 11 Jul 2024 13:56:24 GMT