A custom tokenizer with advanced token handling.
Project description
The author of this package has not provided a project description
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mini_toker-0.2.0.tar.gz
(25.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file mini_toker-0.2.0.tar.gz.
File metadata
- Download URL: mini_toker-0.2.0.tar.gz
- Upload date:
- Size: 25.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4435f2af2d6960c478789c3c690bbd3bceb40bf3aea5974452fb39a1a3149321
|
|
| MD5 |
f37ea2b9c408bb3b792a8c1d1bb42876
|
|
| BLAKE2b-256 |
96c7ce3ee3547314e956b43c6059bba7a704b09c447096c7eb77a3988e27fa37
|
File details
Details for the file mini_toker-0.2.0-py3-none-any.whl.
File metadata
- Download URL: mini_toker-0.2.0-py3-none-any.whl
- Upload date:
- Size: 24.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
401b7a422a16e9a91838e6b4a06688566df974b69ef555d3645ae04e670c4db1
|
|
| MD5 |
b9c68f501884d355c71342e72b5ac997
|
|
| BLAKE2b-256 |
bee7f76b4d307b8c5839fadb72cc11ac456deda906a526485d4a4f3d5e362f01
|
