tokenizer-hub

Yoctol Natural Language Tokenizer

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Project description

# tokenizer-hub

yoctol 乂卍oO煞氣ㄟtokenizerOo卍乂

Tokenizers have the same interface of Jieba:

`python from tokenizer_hub import XXX_tokenizer tokenizer = XXX_tokenizer() tokenizer.lcut('我来到北京清华大学') > ['我', '来到', '北京', '清华大学'] `

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

0.0.1

Aug 7, 2018

This version

0.0.0

Aug 6, 2018

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Aug 6, 2018 Source

Uploaded Aug 7, 2018 Source

Uploaded Aug 6, 2018 Python 3

Hashes for tokenizer-hub-0.0.0.tar.gz
Algorithm	Hash digest
SHA256	`05aa40c27fa89009e636b20851adbe2228e0913b0c3db323247eb8e05931f53b`
MD5	`655374ed5c8da97510b89fdad1071c41`
BLAKE2b-256	`b2cb5ad4639661d82024ecfdb43dd6f9972aab7b38b9bb53ab0926b9b36a16e4`

Hashes for tokenizer_hub-0.0.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`a96d01e2c4243c5e9716216d8b6765b522949d90ff5af00fa205197881352c32`
MD5	`75f83be135c66bd8dc89ed7255c5427a`
BLAKE2b-256	`e06dec703a2d0717cc4c14b556cea01dd0e24cac6dfb5f0f5386ff161973901e`