a tool that uses a parallel approach to tokenizer to achieve superior acceleration
Project description
ParallelTokenizer
Use the tokenizer in parallel to achieve superior acceleration
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ParallelTokenizer-0.1.0.tar.gz
(11.9 kB
view details)
Built Distribution
File details
Details for the file ParallelTokenizer-0.1.0.tar.gz.
File metadata
- Download URL: ParallelTokenizer-0.1.0.tar.gz
- Upload date:
- Size: 11.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 6831e9ff09818d726b1925bbef4c845d4236103f6af42c056f2140e15f9c695a |
|
| MD5 | 21993a9fe48e77c0ffc3322652eb9ca8 |
|
| BLAKE2b-256 | 81eba4921dcee058856db21f6c638b78ba2a6b526e30deed2111e36230ec1b1c |
File details
Details for the file ParallelTokenizer-0.1.0-py3-none-any.whl.
File metadata
- Download URL: ParallelTokenizer-0.1.0-py3-none-any.whl
- Upload date:
- Size: 13.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | b37abdff2edc3c25adb286a4d2c63f72b8c6f2c212759e5fb9751d03f85ad5d0 |
|
| MD5 | 6e64a889473d5b6ee8b2af1f0d4d9293 |
|
| BLAKE2b-256 | 07ba23979daa04b91228ac477e41e8e6a5da0801175866f4abf5e10e01e92db9 |
