A custom tokenizer with advanced token handling.
Project description
The author of this package has not provided a project description
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mini_toker-0.4.0.tar.gz
(25.2 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mini_toker-0.4.0.tar.gz.
File metadata
- Download URL: mini_toker-0.4.0.tar.gz
- Upload date:
- Size: 25.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7127bd3c1735f9ec19193389dc3a79962ef6c3f98b023f1f411e33561f097015
|
|
| MD5 |
e25f4a1e1c66feac27ef2e69f96ffd50
|
|
| BLAKE2b-256 |
0c54cfa35a2996e2b009214e594df945073eb1c9c9787ff909a194961723576a
|
File details
Details for the file mini_toker-0.4.0-py3-none-any.whl.
File metadata
- Download URL: mini_toker-0.4.0-py3-none-any.whl
- Upload date:
- Size: 25.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0ea729885c4e54218edf9142e1e42c498fc87a066269d8567391d1a492a2b930
|
|
| MD5 |
445f8816c15d77394e5170badef65367
|
|
| BLAKE2b-256 |
5bf8cae4d9d8b346fecd81d6cea90e95a930e0ed67743e6059c2b79ace6e088a
|
