Fast and Customizable Tokenizers
Project description
The author of this package has not provided a project description
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tokenizers-0.0.2.tar.gz
(18.3 kB
view hashes)
Built Distributions
Close
Hashes for tokenizers-0.0.2-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7621c4c2e24168a99e248bec139588c444ec5d3fa24709fd66a07910c3650b83 |
|
MD5 | d3eabc2fbdb57a1d454153371f173f4b |
|
BLAKE2b-256 | 8313b4893104f9cf38995064bfe998e572b2d1a701a185ed8724269dfb419057 |
Close
Hashes for tokenizers-0.0.2-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5587d6b12a159bd3ac44a150d9039fb19bb721b3c8bc45a92fec11cf84876f4a |
|
MD5 | 790e2dc3cb3b92670ff6ceebfe80974a |
|
BLAKE2b-256 | 7a8af1e0b4995a94bf7a1989d58915e4da390ed8cb9135ac7caff56f73fede50 |
Close
Hashes for tokenizers-0.0.2-cp38-cp38-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d78e818be071c8234d196b75701f0c61cf1ab7edff690c7eb081f74a2cd2fc51 |
|
MD5 | 536392c724b174d73d640536be514606 |
|
BLAKE2b-256 | 1272477115beee1e51a4a526b34086456f59c7e14dae15045c76be2aa6fa3046 |
Close
Hashes for tokenizers-0.0.2-cp37-cp37m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5af14c7572388e6139ec27a59b0bea80a4fede5e02bf35c3cda1f0b8795edecc |
|
MD5 | 6505019364607ce83ed6125244ced620 |
|
BLAKE2b-256 | 3adb4db2f0d1cb90d293dadc091a37efcf5849ac1f185ed82c18dd4ae2f330ee |
Close
Hashes for tokenizers-0.0.2-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc773c5ace59398ffe628ff50e36a550467e31486fd1cd54cee8d4c16ee7cf9d |
|
MD5 | f7353495b84b3a3dc7ca191b475aaaa2 |
|
BLAKE2b-256 | e9fc3112b7092c0472960d5274467b6d2587835ff4c6e9e7406c600143e22d4a |
Close
Hashes for tokenizers-0.0.2-cp37-cp37m-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fdcf5518126f31e2793475b900b8130c1ec0eb5c813fea9a6429d010468a66d4 |
|
MD5 | 032ea971b49974ec68243edf152dee95 |
|
BLAKE2b-256 | b1871c255a9b2d42fc75bdf7f637378b051eb9dd851378427bf54948dec399e2 |
Close
Hashes for tokenizers-0.0.2-cp36-cp36m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c80bac8cef483f255f0ca1764e991592535ae220d0c10091ea9eedbc8644cb94 |
|
MD5 | aa8e62e661cea90bb1170d297f98ef46 |
|
BLAKE2b-256 | e07fbab0970798da098a8103cadd0d61b868ddb0e855943b9bb2bdef1166ed39 |
Close
Hashes for tokenizers-0.0.2-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b8a9430acaa61efe6048a51606b2b998e98fcd3a343aa3180734760672ab2a5 |
|
MD5 | 5fb6e00ed17f3327ad62509e08bcd8b9 |
|
BLAKE2b-256 | f196cfdf66bef9408f697feb2205702b5c6e6f9aacb742a7b8734eb36ca0503f |
Close
Hashes for tokenizers-0.0.2-cp36-cp36m-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 371b33615a8eb3637e41b766cb5d0abbb530c2d5dc2aa8bd9a8e720b412b3e27 |
|
MD5 | 57564af795342a216576ae557a728527 |
|
BLAKE2b-256 | 9fa833f0c7723b84ed26688b8afe92dca43d16085656f4745cf9e4262b2c4795 |
Close
Hashes for tokenizers-0.0.2-cp35-cp35m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d7df6ccafe28e41addfe612e7f0b8ff41c4fb15bf6f040e84c49a7d801d8c9af |
|
MD5 | 5a908537be2acb6f80cae71432b02332 |
|
BLAKE2b-256 | da957037760fdcfbb2c1834901f10cb4961f6f94d02e3bea544119aeef52435a |
Close
Hashes for tokenizers-0.0.2-cp35-cp35m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21a992a740ab6d98e2d9e80fbe6e476fd57f95583d5181451aa5f4ab03932785 |
|
MD5 | 8f5f8ab851b48d8cfd26f6ae227f5e72 |
|
BLAKE2b-256 | 4ca1170f7695a977bdaae9ce59c4a9071ae1057b35f75c33a0e31cca336853c5 |
Close
Hashes for tokenizers-0.0.2-cp35-cp35m-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | de7f34c0bdd068c5ecb44d8b6b0bf2641849804333e6c8a267d3d8717370cd00 |
|
MD5 | d00336fe0c69743d150f6a782abbe5a6 |
|
BLAKE2b-256 | f43f2649acc41f9564722c8175defd57fb2943dd58cd262d14727e8f07dc9dad |