No project description provided
Project description
🪙 toktokenizer
toktokenizer is a BPE tokenizer implemented in rust and exposed in python using pyo3 bindings.
import toktokenizer as tok
bpe = tok.BPETokenizer.from_pretrained("wikibpe.json")
assert bpe.decode(bpe.encode("rust is pretty fun 🦀"))
Install toktokenizer
from PyPI or from source
pip install toktokenizer
Performance
tok: 16.18MB/s tokenizers: 4.89MB/s tiktoken: 22.98MB/s
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
toktokenizer-0.1.1.tar.gz
(655.5 kB
view hashes)
Built Distributions
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0841e7a719ee0c8c067f1d6b5b9a3e0ae6e4e13c1b0822959099cf2b0e5e769a |
|
MD5 | ab9b84e8d0b25cb5e49a19e9292de42b |
|
BLAKE2b-256 | 46f6f077a18a377f8427bcdaf82c3a7627481e7cfeaa1bb4f875693affbecf5c |
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3426deebfee9233a6789f5d4853aae24d837e3e9427e9777c7a60c9efc1f55fe |
|
MD5 | 7aa43134e347b491e39cb859dd9f8b70 |
|
BLAKE2b-256 | 706a29640a478264ed706e91e52fe5589f4332c3aac6fc71dcfd3cfa332ad763 |
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6519c4bf9317b53109f58a5458b36f191da3ab2fc1fe4d8bf0389155d8c28e3d |
|
MD5 | d2881e75f06b2799301c9c88d01c60e2 |
|
BLAKE2b-256 | f34dbc529b2c37f6cb0c1cfe66868c19df1ed4465c202e27b6ed622630ace4e3 |
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e3cfe9b7be05e7a5b20ee653aeecb9d23a6d53d3902c9e4f8ee8de207567c626 |
|
MD5 | 89e1e1e87003739ea851100730374b50 |
|
BLAKE2b-256 | 9c6e3304ae1873f17b49476843b742be452b121ac5c18922d8773aba7c196125 |
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff16a6e452ee5a26ee4ea35985bc127e7f67fac009fca4fbf9b5e30994123756 |
|
MD5 | 4ca1c1fc9dd490dc9b061d1cc06a452f |
|
BLAKE2b-256 | 50254e4f727b5cbe20661953f24f1adebbf905dd7ede32282303b53bf73770f3 |
Close
Hashes for toktokenizer-0.1.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a89b6739f051e1855c344584cec4c273e6ec0328d95fe3ab9495b2692dfca0da |
|
MD5 | a72f34d2893c991545d3051661ef4328 |
|
BLAKE2b-256 | 82a5084a953f3f18b361fe7065c995b51d0fe1ba6f68c17e4f441af7c5e09b1f |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4bf06ac745788f4d334df4df6a4f931630d2ee6218c06da3096b9350644f40a |
|
MD5 | 541ab06aa21d51724a9ad2bd06aabbf6 |
|
BLAKE2b-256 | 6dddcd941027e9f3b982de5940d5b050f523700d0bb181951a1768785450663d |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | efd0f5d5a6714d329ace83208dba6ff65182b9f3dac978eb57b2f9ea5953e07e |
|
MD5 | b8ddb0090049b9dec96ea3da86b41fd4 |
|
BLAKE2b-256 | 4e5914adeae000a3d57ae1caf2a83117a51f95d1fb0cfc5443173cb016ddf762 |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c0f0cde5cd5f10b64bfe88797ce323db78ecf43c7bc3b68f9cb9c7b0b2b26d1f |
|
MD5 | 63a9233857e5632daf7e537760df635c |
|
BLAKE2b-256 | 326c9cd1a80e9563ddb24980e33f735169978e9e893490f791f61db88f0ccbce |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 30da9c3d29680de7ec56f9ae9d08ff755db993575b0a32469964fe711a4b0799 |
|
MD5 | 2d7832474d5717343245c815c5cff872 |
|
BLAKE2b-256 | 16e8f5ad92d2360cf503968ca8daac5ec0b0200b44d9585b7ba1fec482dda5eb |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc8ebdd0cc2f7030216918e100d68bfcf7836405f4ceff034336bdd13d433739 |
|
MD5 | fb7cbfa2678680c5d93b48a31efcebb3 |
|
BLAKE2b-256 | d692b26f137b39b12a0b78266e9747d4f9e9a9ed422e0d430d8a6ab6c03f9842 |
Close
Hashes for toktokenizer-0.1.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d13679f47311b6864d54c96209a2fff838f39024cd50198e225c61ecfb60f147 |
|
MD5 | 3c1eddee57e6dd89852118a106e1fa2e |
|
BLAKE2b-256 | 3e739eb88d6f79af6b1fa390ca34d577d51b888bf425b28a52c0a4db0c9cf51f |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3fb1fa19f2e544fea383dda75d95d37b73199dae40abaac77378fe3760e905b0 |
|
MD5 | 966c343dc843d0672b1d5ebb3bfba85f |
|
BLAKE2b-256 | a78eb9d4b615479254ab04c916611c34dec984be1ade954e03946804e114b1c9 |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c8b8a592a823c9a97cba6605874dc360595035a520e01eabf25aed76f13f4553 |
|
MD5 | f1663e4b707678ce5effdf76555ae9ad |
|
BLAKE2b-256 | 13da92a378432627976aa1e8f740cfc31c4c39fee421b22c438a576f523f800f |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1479d5944ffeffdefd7635040e31691a95755b4f7d0ced9e54677610e00c376f |
|
MD5 | 3c24d29205ca97c2ef8f1034ae49fb5b |
|
BLAKE2b-256 | ac2fa43c79832e6df8717d45269be01be4762057cdce18746492d881e931c133 |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c31aa69cd55990bf05bff1411fa713914489c72536d3cf5b1ce4271379f031f |
|
MD5 | 7f067185564fe004bd728dc208ef33ae |
|
BLAKE2b-256 | 60847177dc075d209a5e6199bd0f5e13ddc67f3dd824d1a4110d029dd483a21a |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 97f1203807bd45d8cac49c43042c26d1614124783704c48226f29512c3bd3a2e |
|
MD5 | 5c86358fdbbc97676f486f47c5c68bf1 |
|
BLAKE2b-256 | c3fdefb7c5cf2dc36326e48b5cb53a3957e478a89e229a845f3e888cfab0619d |
Close
Hashes for toktokenizer-0.1.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad53500dd72824a4ee6fb28f879013fe466bd72befc1d9dc1696a885a0383a64 |
|
MD5 | c2a672477497f2b0a65ad7a1c1a76ce2 |
|
BLAKE2b-256 | e208acf05aa088074c4f6762f5149e4300ee3e0341e96bf672fcefa9ee0e7acf |
Close
Hashes for toktokenizer-0.1.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c690889ceda672acfab37d3241476ab6b190f3a6844d50e388fb2c8d57beba7e |
|
MD5 | 5eb794998fff87f147d13671c098c898 |
|
BLAKE2b-256 | d0bb6d7ff34d5a72edc1e1be634587f0efe22d6f1b294927ce9a10c73a8e9f01 |
Close
Hashes for toktokenizer-0.1.1-cp312-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e4b50ae8ba9b66bba2006dc517efd96c7f84a1cc9e9331187da567970dcf849 |
|
MD5 | 52b16c64c802dc5a7043fe8ce27cef17 |
|
BLAKE2b-256 | 225b95975d608c18a3f988a70dc17bcb96b0924ae0db8a083bae5bbab6b0b7b9 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 858abcbb58e1d38efc70dcf2267b2165ee197f682eeb4a87d40b6431e5a9d6d6 |
|
MD5 | 91de9412a5773b23bb224ceca77dfc6a |
|
BLAKE2b-256 | d0dbcf6df46ab35cc8ee4ef697f29a3d0d1d072d96a66ddbfe261b867eb8e675 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 45b60ee58d11e4733ecfb73291e3beef584739340a83bad95a8121eacb78d734 |
|
MD5 | 7e6801448af81c6fdac11793640e530c |
|
BLAKE2b-256 | fd9ea9d09a4889be7f3b8c560eef43119b7689febe5529ec8b0dc5da47b2fef3 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 98ff3ee4880a4d086eb222f9d7138ee672fa526cd8896c19c8d4403ca48f2936 |
|
MD5 | 10ecef700625d1323f972a64c2a6a936 |
|
BLAKE2b-256 | 4a1de75f1507614d725b99497f3ece9f09cff217b2d8db9d1344a35e5130480a |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3b04629be7c7e44b2d4077c33c1f46c0ee604dd57cabc47d223063b2a62c419c |
|
MD5 | 9834250f7c49ef1a4a549b8f75903c9c |
|
BLAKE2b-256 | d5fd80a8c7d244ec19ffdecb1e5d802e11d7cd40ff8d153275df3c90b0e7fd6a |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e98cfdb08ddd238f039b04ba3c528eed5cae359d0de6fe87e5a00b966c4e72b |
|
MD5 | 320f78ee1db4434d83524e58fd22d27d |
|
BLAKE2b-256 | 2caa9e97a67a683835079c3cf63a72b6df9d54603d9978be06548d6d5202e531 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 071e1c256fdc46c3f38df47d602d21a56b5105a11fd51be4ac8005af66b15936 |
|
MD5 | 9389827b4987581eda92440fdbddabaf |
|
BLAKE2b-256 | 9283d81bc4f756e8f395cf1d6aa458377748e7df5eee91a091e11a1511394237 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33d7d0bbaeea7509fe76fb1216aaf0d1b8b3c5f4e9d193523318efddfa2a0ec4 |
|
MD5 | d9583c04cb782e1ae089ebfab0bac6c6 |
|
BLAKE2b-256 | d5fd163851dbc9d3df344c3eb35800388ac235fa3280ad827508ded383de14a2 |
Close
Hashes for toktokenizer-0.1.1-cp312-cp312-macosx_10_12_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39b3051e03c9379223dd67cf9e662d2d04aef7bc4ac580f5714fef4baefce19c |
|
MD5 | 20b72c24ec268d8fbaaeb64c36065d6e |
|
BLAKE2b-256 | 5d166a4ad04199050402007827ca3bdb5ea566b1bfba12ab74b0f17439938864 |
Close
Hashes for toktokenizer-0.1.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c0c322d43c6159f130796f9da63bfd423d7950f752ff130ffe9110ffda729c1f |
|
MD5 | 606c726d69f7d57e767c38ccd6c8e0d8 |
|
BLAKE2b-256 | 611e4dd93248a1f3452dce74b07f3ca84e70082b881c10ca4e26978372c00b0f |
Close
Hashes for toktokenizer-0.1.1-cp311-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b5693fd0cde3fbe95c345abcf6db6d80b694156d291645c6d44d4b2be8c3010c |
|
MD5 | f39afde5e1f94fee5fc09f3cbc2169ba |
|
BLAKE2b-256 | 9b2e34dc7dc7292b4f1bc5eb3f9c61581bb114e056cc700602343f8e1ee82189 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8a7b5c73b4138704bb384b3965703b27b976554380f2914e38ce1d3cb12ec04 |
|
MD5 | 508d278f311eead508c37992af8fd96e |
|
BLAKE2b-256 | 5a4473243acdf19b34d0913618d9a881adf7351cea29600d2b15e6e7d3fb9ae8 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8dca4ce37cfb88d8115198d53a9eed4fcca5853b00427869da46e85b054600be |
|
MD5 | bd27472197716c42d792fe55544a9f91 |
|
BLAKE2b-256 | 45c767116ecf6e2698db26191269d1d5878b6324220c41cdc5add3f8024e1065 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b44530c4b0e32831ead08fb9852beca826834bfd9af14068c32d6a891da2085e |
|
MD5 | 8134c635a8fc0c60af73a848c8d136e8 |
|
BLAKE2b-256 | 684d8903c2837332d275bd31eb17346ba093b9db43eda722c723327a7e2c2f02 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bc9176c86a67170a2c3c08c91cac2e89528c8501cf5101e2ffa32680c26984a |
|
MD5 | 22ead652111e64cad6c2d8fbd6d8cef3 |
|
BLAKE2b-256 | 7d69924ab4f656d93200f04e17a5705fdc6dc8c203c687c0c0b3336f4dd3c170 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 702090242508c6d444d77d46afcc6da6df9d2dd5727d46fc4d5b4b2fa8f658d8 |
|
MD5 | e05cda7031bb268fe47699806561c02e |
|
BLAKE2b-256 | ccdd9393b99ef176d8466e7cd6fb475d3ea4715218c4e1fae82cf28f8e9ea0d6 |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 666fc4d6b01dfea16d09a8b8a7507d4055395ccdbef153fbc0241c993e59752f |
|
MD5 | 5da239aa66a5a46d0a38460b9c008d78 |
|
BLAKE2b-256 | f769639f57a890f5d071c0a8d442af38a983efed04d29c8c1956aa87b1d0157d |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd47b25e91a1689acb0baac81054bce89d11bd36cd277e5b56b87e9957e0567b |
|
MD5 | 8532e853753e3bad1e1be7cd3016a96a |
|
BLAKE2b-256 | e36321d3b5a37fe2cb7881f05ad60e07233faaf5695ae15641941238b406f43f |
Close
Hashes for toktokenizer-0.1.1-cp311-cp311-macosx_10_12_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cfa5d8c9fe1efcb22f30c7d62440d2b17ec0635cb36ab0102791979d4ff142eb |
|
MD5 | 489e72d9fd80d8c674e825b1f90a5b8b |
|
BLAKE2b-256 | 1cc67cc428fbdbb716487dfdfe3fae8e7f388888e224b340ed0f194f66bac26e |
Close
Hashes for toktokenizer-0.1.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d65ecf9981668e980c165a3404a6491a93cf51313a65ca9cefb1df148930e121 |
|
MD5 | 48cb6461dbafb25b59786b10e926d83a |
|
BLAKE2b-256 | 7e2e9422746081ebf485f28b789169ca4fda68ab6f7440db84123c92dea79b9c |
Close
Hashes for toktokenizer-0.1.1-cp310-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5ff0379dcb0a8775440b0d428d31390065a0d73519c3c9cf0bf5d9d756fc514b |
|
MD5 | c0db7d54838cdf25c97a5acaf28a6f96 |
|
BLAKE2b-256 | 52a5df96d2f8ff8f1ad4c4bd6daf399afb8178438fe2d04ecd59fa9586cc7c28 |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7fc8de11a819d86849149da0f697f6f31b2cde0b8514a3af8c858f87f0d1a727 |
|
MD5 | f9199d06b43c7eba45ef576a3b0d8a07 |
|
BLAKE2b-256 | 2f43920cf303197923367198b0126a166fe00625379a89be6c9dd974f3e619e4 |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6ca49aa82b4224af0ae621d17c13a0da04accd4e1de0e51bce81b769259a1ba |
|
MD5 | 07424cfd67f6a9689d91c5903daf69e3 |
|
BLAKE2b-256 | 75f5119a5f46421fe97f3c4a602310227abda25c04dfc78ac0c808e23fea7bdc |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67a1d2ada3ec20cf6d275adab1a28d38a3aeab4c87acff46619aa6345be835d9 |
|
MD5 | 61f42a5fb5b6d78608d663239ed63b7a |
|
BLAKE2b-256 | 4257ea0865b1cd6890b1972a89937dd49038d6c571a87625b8cd695eec5d7e38 |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8aa5093eeca984a37ce38e2bfbc1e5f17e80d7b002e5fbb98b86f3d45778c6dd |
|
MD5 | 2e9bd2e5f87bcba0a433fe53e8003f8d |
|
BLAKE2b-256 | 40860dbe0fa283d29c7874e968c390529a27e47a10cacc033b70341df19c262c |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e50f3b0a778e0249389784d2ff39b5b6d44c58c9da515d85e82a658638088731 |
|
MD5 | fc4b2a581a285ddc62d2f91dbb258d36 |
|
BLAKE2b-256 | a4170331c7c3653eef1b26faa43d02b524cf9c18d9606f99a1b6726f4aab4d47 |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b146907050598a2c6e970c05d017370793f827cb4a8933fc239ec2788f1b2c1d |
|
MD5 | 281d70864fff902b6f941771482a53ef |
|
BLAKE2b-256 | e2fcb5df8daf992ec22a6bb88824ee89fe0064910b1977ac8f03154b9dbf8cb4 |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-macosx_11_0_arm64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d0670cb0941762834d3fce902ccd43fd6332feaba448d6da67cb54f4bfbe530 |
|
MD5 | e60585cfece12e596b556f7e21cf827f |
|
BLAKE2b-256 | e07c4e78f5ee8150befca9b3d7efd9071a737f33714d7ff678a9582a94fc7d0a |
Close
Hashes for toktokenizer-0.1.1-cp310-cp310-macosx_10_12_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbf4a7c33fd091b57ff89b0c64678e34f076e330456e9347cbe89b5ac0f8afda |
|
MD5 | 65af0e227b6987f9db1875f252071420 |
|
BLAKE2b-256 | b6c2582f36ef0d7e5719eee960700dbbeec7b34250e1ebc2b6c401eb15376883 |
Close
Hashes for toktokenizer-0.1.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a4f82c9fa80207ef74d77786af96c29b755650b193159e9fd2c555aff3687652 |
|
MD5 | 2b9a7327b014dec5d594a375f7447a31 |
|
BLAKE2b-256 | 52b6daa0d819452ab0534d6ee1a9b3be39e6473adfb42694b4ccae202de0f504 |
Close
Hashes for toktokenizer-0.1.1-cp39-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d0664de2a7ab77da95c13ad133f0a23b8d44b800297b57bc5a72e6b386a697f |
|
MD5 | cb73f163dc0265677657a87e7bb1ce07 |
|
BLAKE2b-256 | 6b633efc9a59b61ce340efed17f2e8b5232a64acf2efcaf02d177e58312edc78 |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6376baef51da0cfd9fb395c7850e295a259ff3ba4db961a0e47b011ce3447bcd |
|
MD5 | b052644324fbdec9cc38093b560dad62 |
|
BLAKE2b-256 | 337d6af8c82a4032b4953a29b2171ac4d89c718f13273d6edbeaf2145d401871 |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 171c34387a845d525ddf8280c96a977a64b7114bce41af67f8d85bda9e0bf7d0 |
|
MD5 | fc8a79f92a6280c7b7a47dbbb312a3b2 |
|
BLAKE2b-256 | 64459ef9613973d636a1674a2884114b4868b563e10ee84b1914afdfc88017fc |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 655453fa3cc75366f54071b104090778f61f6947f0133406c3083ee9e5905546 |
|
MD5 | bdd846f9de4ffda0ffc331a45db82862 |
|
BLAKE2b-256 | 4b3918e3bc2c4b24e6f3b54a98b688b841d7634f2ba24969570b3a3f440218de |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7197c74f7dc71d54f3ef9b2f1e36640bd0a4c71e92cd3351df9982fe4d10fc2 |
|
MD5 | 75669d195f6725d11c4bc72928795e97 |
|
BLAKE2b-256 | ff6bd17173574d0bc0b94f458e69a8ffd6eb150e506f84f8f0984452b3099e17 |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fcf52ff4c688e0c1c46c4ca14cdd1a684b2ae86f8547284c7740960fdee2f7bd |
|
MD5 | 26f3524a9a61d8c89727b3bb3c5ecbfa |
|
BLAKE2b-256 | 75ee2dab6cd79f75e8b08bcb5b003eaea9c0a53b7394fe4d1ae9d4e1069e955b |
Close
Hashes for toktokenizer-0.1.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 913361f7a416affa090c8b20aace30c9a55454701c878afcacab0f7a7f51fdc7 |
|
MD5 | 6d29ad745d594d93ec2adfd337388494 |
|
BLAKE2b-256 | ec4999f95c163cc14427fe3979d24e52d87121c0e4845b45d716f9afd371d91b |
Close
Hashes for toktokenizer-0.1.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a50f853df63ed2d8b3ea516311accf9b7c64c6f3f2ba5b58343515f5a30cd0f0 |
|
MD5 | 1e433a74c23a51968e19012eb760103f |
|
BLAKE2b-256 | d6f643cade7d8fc69afe072bd51024333debfe15c3febea879ed56f158f73df8 |
Close
Hashes for toktokenizer-0.1.1-cp38-none-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e824aca61ada249bd69b1cdde8bebeee005001026808d14dd1498de5e35b19d |
|
MD5 | 1b4c6af8b2d57bb700a68386f1fd09ba |
|
BLAKE2b-256 | 3b251788184dcad9aefc509486e9aec0e0840d9f004f057eefb08c3a6bdae7ff |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a5ac2e915894323adf51dd78d35afd9a387d9d989dc970946ec2c252bd13197f |
|
MD5 | 41dc93903aa9e124f31e6b4dd89f2152 |
|
BLAKE2b-256 | a51268c9baab543ef550caacfb2dc6254733d53b23031f26bbed4aadfbdd0329 |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2346a8fa19e66ae5fa3360f36736160e1b698ce0d8a21e59c0594d838a22590d |
|
MD5 | 4565e062e67ab4a29872d61fad463bca |
|
BLAKE2b-256 | 048353bb21939b2e3c07352324f8f3fb0475e68d1cc4cbb5907661dc5d54a8c5 |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 57844a4963c7363d7b437f172a575fe4c9cb03879ec3bf358d9d0b934bedc4c7 |
|
MD5 | b0c6d6d1f00bee6c1a69a1a2f3565309 |
|
BLAKE2b-256 | 7f81fc288fa0ac00cf03855cc57a6176a159032665f42c7fa8f74c7a9678ddfb |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1191aa101a6165a4b5473fad9f1dfc7c2ed030702478c91852fd25db6241de76 |
|
MD5 | c02ca1d1dff3b216f622ce536d35cb4c |
|
BLAKE2b-256 | 9efef02ef6d641aacd2e74becf4a0361d1130189d3918a79e72e08d60c2719c9 |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 18cbfb7922d07915a7341c467d1f3f1c7095ff02d57b667e0d280e0c1799b72b |
|
MD5 | aa36ff9b55c5129dd76a8ab2f6b6df84 |
|
BLAKE2b-256 | 4650b9167b5e1fa64c37178cdb210f8dae9fed1039eb0372d734d9b329ab7df1 |
Close
Hashes for toktokenizer-0.1.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bafdd514bfa41ab45ea0c69139a2fcaa1ebd55f065b73546d4aec3567f5addd |
|
MD5 | 8b7ceb84281ba831466aee9418cb633b |
|
BLAKE2b-256 | 1f600abb7d0d6f1bbcce2ee305f54df244bf85ecaef1314d2ffac59da42684af |