Tokenizer for NLP
Project description
ft-tokenizer
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ft_tokenize-0.1.0.tar.gz
(3.3 MB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ft_tokenize-0.1.0.tar.gz.
File metadata
- Download URL: ft_tokenize-0.1.0.tar.gz
- Upload date:
- Size: 3.3 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
900c33d2afcd029ed858cb7ba99d044b93b532c9f0fb197b2ae9f789e8109ad4
|
|
| MD5 |
912797a1bfd74f92030d8e998de1c5f7
|
|
| BLAKE2b-256 |
cd14090dbf527e0eccf5d7871457d711d4ebd3c41a61d551362a4ac7f1869672
|
File details
Details for the file ft_tokenize-0.1.0-cp313-cp313-win_amd64.whl.
File metadata
- Download URL: ft_tokenize-0.1.0-cp313-cp313-win_amd64.whl
- Upload date:
- Size: 2.4 kB
- Tags: CPython 3.13, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c0fe41fde42b0b23e3f003482380020d377e9f8624f199625b73e6b95b9ac7d9
|
|
| MD5 |
0baa17be00d5def29dc3f796801cd86f
|
|
| BLAKE2b-256 |
57a5237a24a250a148273772f076da1d4b06c2a5aac43c11ebad83f9beb050a8
|
