A small example package for tokenizing text documents
Project description
simple-tokenizer
a simple module for tokenize text document
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tokencik-2.0.tar.gz
(2.1 kB
view details)
Built Distribution
File details
Details for the file tokencik-2.0.tar.gz.
File metadata
- Download URL: tokencik-2.0.tar.gz
- Upload date:
- Size: 2.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.10.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 27fbcdbcd260cad0768d91b53e26b42a1b90825625fc3edb1bdf7655c21e486e |
|
| MD5 | 61d908023d4a7b9e2aaef0106ff8cf81 |
|
| BLAKE2b-256 | 63e98ca8e7915ba9596f594ff59e3424a2f53a54ce7d9725cf38a845c2214aae |
File details
Details for the file tokencik-2.0-py3-none-any.whl.
File metadata
- Download URL: tokencik-2.0-py3-none-any.whl
- Upload date:
- Size: 2.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.10.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f9d3d6a05da0bbb49491f021473e3f38bc4c744614bedebb3cc681a354ab699d |
|
| MD5 | 42f4a06472fa58238dfafbfd1fa88b09 |
|
| BLAKE2b-256 | 2c0dc645ea5af847903579d308c9052977ed882e7e7ee3203ede753916b24ed4 |
