a tool that uses a parallel approach to tokenizer to achieve superior acceleration

These details have not been verified by PyPI

Project description

ParallelTokenizer

Use the tokenizer in parallel to achieve superior acceleration

These details have not been verified by PyPI

This version

0.1.0

Mar 18, 2024

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Mar 18, 2024 Source

Uploaded Mar 18, 2024 Python 3

Hashes for ParallelTokenizer-0.1.0.tar.gz
Algorithm	Hash digest
SHA256	`6831e9ff09818d726b1925bbef4c845d4236103f6af42c056f2140e15f9c695a`
MD5	`21993a9fe48e77c0ffc3322652eb9ca8`
BLAKE2b-256	`81eba4921dcee058856db21f6c638b78ba2a6b526e30deed2111e36230ec1b1c`

Hashes for ParallelTokenizer-0.1.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`b37abdff2edc3c25adb286a4d2c63f72b8c6f2c212759e5fb9751d03f85ad5d0`
MD5	`6e64a889473d5b6ee8b2af1f0d4d9293`
BLAKE2b-256	`07ba23979daa04b91228ac477e41e8e6a5da0801175866f4abf5e10e01e92db9`