Tools for tokenizer develope and evaluation
Project description
Tokenizer Tools
Tools for tokenizer develope and evaluation
Free software: MIT license
Documentation: https://tokenizer-tools.readthedocs.io.
Features
TODO
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2018-09-05)
First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tokenizer_tools-0.9.0.tar.gz
(15.8 kB
view hashes)
Built Distribution
Close
Hashes for tokenizer_tools-0.9.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b3acb86eaca6aadaa2ca39398a6aaa5e387a7ed9873944a8abd2e1448c9c5a69 |
|
MD5 | 7029060b8448686b556a9eda145e7f5e |
|
BLAKE2b-256 | 87c7fdae6b87195cdb8c899eddf136c35da1995fdc5de1d41abfcf2840590cf4 |