Standalone Dictionary-based, Maximum Matching + Thai Character Cluster (newmm) tokenizer extracted from pythainlp

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Project description

newmm-tokenizer

Word tokenizer extracted from PyThaiNLP.

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

0.2.2

Jan 6, 2022

0.2.1

Oct 26, 2020

0.2.0

Oct 26, 2020

0.1.1

Oct 26, 2020

This version

0.1.0

Oct 26, 2020

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Oct 26, 2020 Source

Uploaded Oct 26, 2020 Python 3

Hashes for newmm_tokenizer-0.1.0.tar.gz
Algorithm	Hash digest
SHA256	`12fb877e2e4034ce30a296dc09176c42f28a18e6dbf0d08abbe2e51419de8580`
MD5	`b49f09cab155ed99749e1aa717eb1955`
BLAKE2b-256	`25ac119307b2078b0b6a7c62ff99f30df674f8666237fb539ebba8c80d7afcd8`

Hashes for newmm_tokenizer-0.1.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`ab061b2c6784d7181b07b54e0b12036053f85cae8eb52d89f6f22a66f329a0b3`
MD5	`64657924355d2d807a86998b419b948e`
BLAKE2b-256	`beea8d05965d34d1be6499c1fc7ca3d57f4ffa100d52335d503ea3725b187fab`