分词工具, 把文件中的词分割成token
Project description
makeToken
分词工具 useages:
maketoken ./xxx.txt ./xxx.tokened.txt
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
maketoken-0.0.3.tar.gz
(1.5 kB
view hashes)
