Text tokenizers.
Project description
The author of this package has not provided a project description
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
totokenizers-0.1.0.tar.gz
(6.4 kB
view details)
Built Distribution
File details
Details for the file totokenizers-0.1.0.tar.gz.
File metadata
- Download URL: totokenizers-0.1.0.tar.gz
- Upload date:
- Size: 6.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 47d9f5f5174cdd8822a3f5cdf619427d80ac1e94cd7338b79940840a39277f75 |
|
| MD5 | a5dee1c1e378b566f34a9bbf98f364fa |
|
| BLAKE2b-256 | 404a246d763b6489180580fc2be916d97b3344e89c97aedefbc86bc485446fbe |
Provenance
File details
Details for the file totokenizers-0.1.0-py3-none-any.whl.
File metadata
- Download URL: totokenizers-0.1.0-py3-none-any.whl
- Upload date:
- Size: 6.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4c3b45270e132d4d7b3c258876c3ef4301e366c101db45c1bedf0aff1da7e138 |
|
| MD5 | 634619853cfe2f54196ac23aebcb1c16 |
|
| BLAKE2b-256 | 57c58bdaf1136c2c76a5b3d8a66af8726aa417aa845c84a11392a9f85f7bfbfb |
