Tokenizer for world's most spoken languages and social media texts like Facebook, Twitter etc.
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
polyglot-tokenizer-2.0.1.tar.gz
(96.6 kB
view hashes)
Built Distribution
Close
Hashes for polyglot_tokenizer-2.0.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e95e57e50079db8c952288d8d5d5c5a8bb2655d43b8c25f5e8f2bbae7566636 |
|
MD5 | 5b0ab3722c221d532cd41406add6e028 |
|
BLAKE2b-256 | 71658189f4ba5238f1072655408af4179205c0ed5a224d10da3af487786f1dbd |