A custom tokenizer with advanced token handling.
Project description
The author of this package has not provided a project description
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mini_toker-0.1.0.tar.gz
(1.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mini_toker-0.1.0.tar.gz.
File metadata
- Download URL: mini_toker-0.1.0.tar.gz
- Upload date:
- Size: 1.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e71771637198215380796f144fbee56a62f574f9f65982ffcc6d0bfde6bf9c28
|
|
| MD5 |
bd2e573272428e014f69c0bb70c5e993
|
|
| BLAKE2b-256 |
cc76fe9ccbeec934bc85d1ecec8aef95d57b32dfc7cec074c76ff4461ecfb620
|
File details
Details for the file mini_toker-0.1.0-py3-none-any.whl.
File metadata
- Download URL: mini_toker-0.1.0-py3-none-any.whl
- Upload date:
- Size: 2.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7a76683e98c8d5cd3f20b6b124bea3c793c8c588d1a09b8bdf276eea07da729f
|
|
| MD5 |
ce7a2b5d8cbb58c67d039e5288e3aaa5
|
|
| BLAKE2b-256 |
41c7f0a48b03389c1c8aad20bec9c3efd0cfb1dd5cb5874cda01cbf5bf585ed6
|
