Tools for tokenizer develope and evaluation
Project description
Tokenizer Tools
Tools for tokenizer develope and evaluation
Free software: MIT license
Documentation: https://tokenizer-tools.readthedocs.io.
Features
TODO
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2018-09-05)
First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tokenizer_tools-0.4.1.tar.gz
(12.9 kB
view hashes)
Built Distribution
Close
Hashes for tokenizer_tools-0.4.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5a5c3153bc94d6dacd05d46b84c04263024d20abe8da08c806cd71b579b7939b |
|
MD5 | e1b3769343e10985100424138c27b4a3 |
|
BLAKE2b-256 | 3859d9125c06510b853654f116f09fa4254a496274043e9799088e4aecc32cfb |