分词工具, 把文件中的词分割成token
Project description
makeToken
分词工具 useages:
maketoken ./xxx.txt ./xxx.tokened.txt
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
maketoken-0.0.3.tar.gz
(1.5 kB
view details)
File details
Details for the file maketoken-0.0.3.tar.gz.
File metadata
- Download URL: maketoken-0.0.3.tar.gz
- Upload date:
- Size: 1.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e9fe576e0af2bb2872063607aa8afa6987f5cbc8475a0b7118036d2c5a8908e5
|
|
| MD5 |
487cf0e61fcafaeb93bb536769d29f98
|
|
| BLAKE2b-256 |
0a5f46e9849b725c7be8a30e7d9a1886efbf13e412e6989fde0f3247c449e01a
|
