🪙 toktokenizer
toktokenizer is a BPE tokenizer implemented in rust and exposed in python using pyo3 bindings.
import toktokenizer as tok
bpe = tok.BPETokenizer.from_pretrained("wikibpe.json")
assert bpe.decode(bpe.encode("rust is pretty fun 🦀"))
Install toktokenizer from PyPI with the following
pip install toktokenizer
Note: if you want to build from source make sure rust is installed!
The only class toktokenizer exposes is BPETokenizer. The class itself is pretty minimalistic, with all major methods being showed below:
from toktokenizer import BPETokenizer
bpe = BPETokenizer()
# train a byte-pair tokenizer on some corpus
train_corpus = "this is some training data. any dumped string will do!"
vocab_size = 8
bpe.train(train_corpus, vocab_size)
# save tokenizer state
bpe.save_encoder("8word.json")
# load tokenizer from dumped file
bpe.load_encoder("8word.json")
# encode and decode
input_ids = bpe.encode("some data")
decoded = bpe.decode(input_ids)
Performance
slightly faster than openai & a lot quicker than 🤗!
Performance measured on 2.5MB from the wikitext test split using openai's tiktoken gpt2 tokenizer with tiktoken==0.6.0 and the implementation from 🤗 tokenizers at tokenizers==0.19.1
1 maintainer
Metadata
1 maintainer
Release files for toktokenizer 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| toktokenizer-0.2.0.tar.gz | 59.2 kB | Details |
Built distributions (wheels)
Total release size: 63.6 MB
Release files / toktokenizer-0.2.0.tar.gz
| Download URL | toktokenizer-0.2.0.tar.gz |
|---|---|
| Size | 59.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b366ccf58eb2f0fdcfcc4310714eacf466a85e64f1d7ccfb188b65fa39b2cbff
|
|
BLAKE2b-256 checksum How to use checksums |
1af91b2ff2377a95635c3f600156bf10bb30606ed57fe318f54caf26dec1bf85
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
069783d86b946fb1763fe56b2628dc8faf631d629c4a8b7682270e3ee10a7751
|
|
BLAKE2b-256 checksum How to use checksums |
044683deb1b4cc0c4edae6c1372e8c165c1d235bc39cb57b54be52bb0238db5a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | Linux glibc 2.17+ IBM System/390x PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
2424f5c30081e1062345153253a790e6e5b9fc81422b769da41815ddc195bf11
|
|
BLAKE2b-256 checksum How to use checksums |
dc07922e57445b35cb10bda836e84262bc2a296b07aa47c6fcc69f8b49597b14
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ PowerPC 64-le PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
0a38a0fa267a6ac55de5114bf81f1bc4b250e847897eb1d59e53884e457a8f8b
|
|
BLAKE2b-256 checksum How to use checksums |
50dbe41617a872c1873b13dcdb3df0da3511629d2721d50c101b66d441799394
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-32 PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
ebb778bbddba7bebf53b0d5e6b53368257cb8130ae9911a92d98c8391f7766ea
|
|
BLAKE2b-256 checksum How to use checksums |
ea68382167126121376a24ba4beec48aa478b5e1ba5d80c30539e51aa67f0676
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARMv7l PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
2f57a464907d46a07edc132b98ce09131e52bfa801df91ffd11a43e276b61c3d
|
|
BLAKE2b-256 checksum How to use checksums |
b837699ef680585e418fb1e42092fe5b2e20e7096ef36527d6874f40e019ad28
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARM64 PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
7f463a98f4343eba3b4ce39b307b6d10fab8e8d85eb54c5c959ba7993f375f68
|
|
BLAKE2b-256 checksum How to use checksums |
718d56bbe7d8b5cee411b255ca8348f54d6b01af8e0bcdf9ff4de1377f7bb418
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
0b4f5ad04f48bd83fc8da7b8a26022248c4e8de0d9152b7d3ff64068498ff47b
|
|
BLAKE2b-256 checksum How to use checksums |
47394b00a1ee2a73ebf9a7898f7eff0ff1fa2ae4d39c64865c1efd20c8eaf6ad
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | Linux glibc 2.17+ IBM System/390x PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
817f532d3fabde2afd481b8cbd1fbf7dfa5cad5b1588b6d43e12df96c3d27a7f
|
|
BLAKE2b-256 checksum How to use checksums |
c1b2d98fcd53e0952a82bd9653810a16ef160d97c52542a352237d77526b302d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ PowerPC 64-le PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
8c1975c0f7f8c36ae9fbd801a12f35e6afef2d0bb1207b1bcafe2656322e72e3
|
|
BLAKE2b-256 checksum How to use checksums |
be732dcd8482d012b2583b283a0504a4dd61c02b4b245565ed6c1b84b386656a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-32 PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
d11fa5820cd071eef913ec6aadcc00d85d88d5ff146e408f3ad2bb82628091d7
|
|
BLAKE2b-256 checksum How to use checksums |
af8a7da83b0e1e3d1c0fef03d18e1fbb59d7e990320795728f65bd77773424a6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARMv7l PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
93a4ef6e3a09c78636149f216ab40f360f9408a92d8d83a058200142e9d66fb3
|
|
BLAKE2b-256 checksum How to use checksums |
432f345678dd2af2d60573d674a971619aad60667ade0e19940d59d01339bbc3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARM64 PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
d4c1d19848b4c61be7fcd8719e1e7309c9f0a445775b668cea8c571d18894e1b
|
|
BLAKE2b-256 checksum How to use checksums |
45dd3c44e13e80fb490026161b285651c73e509e57ce401f6aa3d48b423b311b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-64 PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
2d07644b4fd4d98024b6c65fe2378d95977548b35e8c3416cf19d45aeceb82bb
|
|
BLAKE2b-256 checksum How to use checksums |
b1c1e36c02a4ae8dd03307fafa617b262c2080147e1f55484eccc6c76fabef78
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | Linux glibc 2.17+ IBM System/390x PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
aba963b4c1f3ae074f29ab1173fc2a70db81924e03201f1556d7fedb917b43c9
|
|
BLAKE2b-256 checksum How to use checksums |
df145a89926f3be99f3894f37344d6f61ab5c75c9b60d41bdee9e9a3cb081f27
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ PowerPC 64-le PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
fa703437dd77ac85d375fd21f62e4ece3ac2ce23d867b4f6613f7f87ba215535
|
|
BLAKE2b-256 checksum How to use checksums |
4fc3d5e3473d6e40e288377fb5502089d59004a5e19b0a7cc90f3eb9a853bfd2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ x86-32 PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
68689fee266fdfe5dc145a376f6719c019d6da59586a9ae975d1605438f55b5d
|
|
BLAKE2b-256 checksum How to use checksums |
02bdb02cf63e8d461e5470158f23b309b95b86af3547496e9dbdf18030835423
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARMv7l PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
c4878f280f8a869d9a9f24240b9b4406e469e8cd250d974396ca2ef936eaf05a
|
|
BLAKE2b-256 checksum How to use checksums |
b68ea0fbeb326dd9a367d9e814f0ffbbdf1cc9b4091d79a166c5183d9e074bf0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | Linux glibc 2.17+ ARM64 PyPy 3.8 PyPy 3.8 7.3 |
|
SHA-256 checksum How to use checksums |
1662d2a1ae9e7926ae58d0c5da3e7d7593f30a0b04be7adf979c12d8441432f3
|
|
BLAKE2b-256 checksum How to use checksums |
4c2b20b4a5cf50f42ba9e19308b995108462470cb0155263474930651d3f165f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-none-win_amd64.whl
| Download URL | toktokenizer-0.2.0-cp312-none-win_amd64.whl |
|---|---|
| Size | 237.3 kB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c875c8ca025853677f00f1b3e38245b99b081514746a34d2fc33d64b3ccb4c95
|
|
BLAKE2b-256 checksum How to use checksums |
e3f33f9fbcdb671e3af7dd9907a30ee6480cd1a06df4b39fa6268a221086821c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-none-win32.whl
| Download URL | toktokenizer-0.2.0-cp312-none-win32.whl |
|---|---|
| Size | 232.0 kB |
| Tags | CPython 3.12 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
9b1b463046dadcfecaa27a3efb609f16023d31f5324379b59c4e79099336b209
|
|
BLAKE2b-256 checksum How to use checksums |
5488346daeeed2c43aca09b60b7fe61e5b14b54c5185a483d28289f00250ba0c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
60637c4506f02109b0709cefbf0e38a2c67abcde0856961cfb5836a9ec999ed0
|
|
BLAKE2b-256 checksum How to use checksums |
4c8970f5abd24665dd5bf14b07ca6d5ab5f0b429ae3c03093bcaa9ef92f35c9b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ IBM System/390x |
|
SHA-256 checksum How to use checksums |
ddc8d7a78e08dfcd4ad6e9b535c2de11f8a1de21b9c028f898466d39098f473c
|
|
BLAKE2b-256 checksum How to use checksums |
ca8ab74ffa9fac4397c5e0a4cd2333c45a47b401a050388ba358cf69f42ac69b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
d0e657d0bc6e42a23295fbf8752e584c389d45ee97aa74e188cebbf49bea87da
|
|
BLAKE2b-256 checksum How to use checksums |
2ca7438d96ab63bf42a25ed9beef90c59d41dbb544789cd51cf98f902ab082a5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
eca1eb616896ee114351b0c84f17a82ab6fd36addabe21242a4528045849610b
|
|
BLAKE2b-256 checksum How to use checksums |
a6536d3738bd73891d38df78523338c6b8b3c78463787858ec0d11e198da21eb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
b30e5309b6740f792d97b3a9c81f367823cf5a2d108c968344d459e01426dc1a
|
|
BLAKE2b-256 checksum How to use checksums |
2d95aada8ea079b24c3cdb35dd55be6dc3a5ab3927f171300b0e38f33252cc13
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.12 Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
bee6cf40fd431d9d8941af90479c67656ab79e4a978355777090bcf0e4303a21
|
|
BLAKE2b-256 checksum How to use checksums |
a8bb864250780722099245bbf3a3a83f23d9cb102db7663dad06ea09ac69837c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-macosx_11_0_arm64.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-macosx_11_0_arm64.whl |
|---|---|
| Size | 362.4 kB |
| Tags | CPython 3.12 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
5a77fbf1912d0b47fd894257db15b17168eed824367ab0e2160942a6aa367781
|
|
BLAKE2b-256 checksum How to use checksums |
b5e240234146d28937dc6ed280a58516b321241ee1334dbea1f537db2f6a10d0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp312-cp312-macosx_10_12_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp312-cp312-macosx_10_12_x86_64.whl |
|---|---|
| Size | 370.2 kB |
| Tags | CPython 3.12 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
bd42f9ad8e56380985256857321c7f85fca4d19e3b6f703c1e7dd7b44a5606fd
|
|
BLAKE2b-256 checksum How to use checksums |
fa4a7beee22a1d01e22f0c127d5a49bf458c59984dd64307924d98a18b1255fc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-none-win_amd64.whl
| Download URL | toktokenizer-0.2.0-cp311-none-win_amd64.whl |
|---|---|
| Size | 238.0 kB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
b9f9cc122d0095791b1a9fa2deb1d3186e2cc6e73d3d13ea8d017451a3df252b
|
|
BLAKE2b-256 checksum How to use checksums |
e6764c5e0c3a204236054a569ba3c161bf9df27895416d4aa05e927384626f29
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-none-win32.whl
| Download URL | toktokenizer-0.2.0-cp311-none-win32.whl |
|---|---|
| Size | 231.9 kB |
| Tags | CPython 3.11 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
f12b4c5f3d8ad53ea6a0bbf9894906143acba050ad9237113e3680041818c9f2
|
|
BLAKE2b-256 checksum How to use checksums |
c3432ebd0a7626fbaa1b91a92d0a5ebe23eb587967cc61496e889dbafc17b8f1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
e2c6b224eff0c16a10af33fbe93df794e20671c628eeed514814b6e84f3e8067
|
|
BLAKE2b-256 checksum How to use checksums |
c19583337c92b42d91d96f9e7fe770882d838c9d3011d2238bafa93ac72d01a0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ IBM System/390x |
|
SHA-256 checksum How to use checksums |
195b9f551e99a698077e5cf8bef926df86982b3caee980afa748e422262877dd
|
|
BLAKE2b-256 checksum How to use checksums |
96e79afb592efd56c45030a867503fa5fb2989087c2d9de0b693f9d5ea74a8a7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
25b7dfd9b2d1ba4b127e464297530d83a9afb3c17ae482a55d9f67a50b75ff39
|
|
BLAKE2b-256 checksum How to use checksums |
b76f7d9981f854c6f7ff8e4c11a069e2b6fc79aae878ba029c07259a79175a31
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
8ff839dca9d04b94bede3d8270ec02c739f0366ac7847c1fdb467ce07041a6b3
|
|
BLAKE2b-256 checksum How to use checksums |
3f5f506ed6714539b2caaab049290b93c95d51ca8bf6bf3fecb5aa32a114e806
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
4c8a2c43047f207fcfc8341e1433f85924726678c1ce98435df35a32ae3f9404
|
|
BLAKE2b-256 checksum How to use checksums |
33087e2ea4b528b812e0904e758454f0d3c555471e7a88a71def04fd2a1d1aab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
f0afcd7c6856e5550b3a9eb7ea20323e1b6e8dc6d08444ab5c77b244567da294
|
|
BLAKE2b-256 checksum How to use checksums |
b2073325b4b58112a2baf8fa9609dc75e09428b4bdb4ca0f2564b472ac9fd150
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 363.7 kB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
04ed43770a4517ab32e8fda0f371b844136e439c3bce51cd49a743a5434674a3
|
|
BLAKE2b-256 checksum How to use checksums |
a4092a7d0f0872a8d4d0a3e65b7bb0667340ec006442c30494e897e3ccf0cc5e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp311-cp311-macosx_10_12_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp311-cp311-macosx_10_12_x86_64.whl |
|---|---|
| Size | 372.4 kB |
| Tags | CPython 3.11 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
50340c409021c2a59cc6cbee2f03728c0f5b0bb5779f6546e46a76fa5dbfcedf
|
|
BLAKE2b-256 checksum How to use checksums |
98d960c6f3fa1d96ab630a2a4ea2939ee4bf8879f085b2e743ddb194f502947c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-none-win_amd64.whl
| Download URL | toktokenizer-0.2.0-cp310-none-win_amd64.whl |
|---|---|
| Size | 238.3 kB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
47282907284791c4a3b80b74b565e48bd2c8cadd43b3d06019f85e8f2f9a0644
|
|
BLAKE2b-256 checksum How to use checksums |
6e637353a5189bd834775b13fbf03ddeafa39bab7ded6ec82a51de62be304f72
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-none-win32.whl
| Download URL | toktokenizer-0.2.0-cp310-none-win32.whl |
|---|---|
| Size | 232.1 kB |
| Tags | CPython 3.10 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
0321ca0530c941bd322e1d08225db0973d1165d63d94b184da7d87cfc35cbf9c
|
|
BLAKE2b-256 checksum How to use checksums |
b779fb361eb81809d70db0525eab98d66ab2a56c6bc26a4766f58339897c861d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
2f9c6b45ef770b74908cc6f3c18a787ab9c1ad7534ed93fc064d5e09954a1b62
|
|
BLAKE2b-256 checksum How to use checksums |
373d9ec9c43a10e2aa8cd891f76c5f428f46fc38b1bc12f0abcd6a6628d3fc4a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ IBM System/390x |
|
SHA-256 checksum How to use checksums |
3ac5944749f2bc357d28db630e185a33f6f07f50d8f2c34a450122f0bc4bb4f7
|
|
BLAKE2b-256 checksum How to use checksums |
2c3d93cbdecf985ed4e97c76d3bce90ba8c3ad8f2a0b5a23808305e028f63cb5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
a7bf30ea08bb5949b54b21047b06726f9a3b90aedbcd4f765c01d5c157f0805c
|
|
BLAKE2b-256 checksum How to use checksums |
adb365d6c9e5fb806e37f52260a1055a4113d807d74e4de1b4999e876b66e554
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
dbe3909377ffbc6b44bf25635545e87810d94bd3266024771ad4e22d80f96716
|
|
BLAKE2b-256 checksum How to use checksums |
b60bf89c1ca1604f02ccf121b6e01c01b48b6c695e7f0ef50d348bb751ffa232
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
8a46e71baa10fee438959cedd5ec54d4b192b56ace2051a7a45ba63cf982d13d
|
|
BLAKE2b-256 checksum How to use checksums |
b331bbf22dd34167c979e7ff057964c3789f32fdf420bfedaa6e9d5ff8cfbec7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
06b146616ffb061bf3bba397b39e67adca08cc160ee625c7bdc1237cce81b0ee
|
|
BLAKE2b-256 checksum How to use checksums |
fceec6991c32b98665850c2221249a97dc403daf561d59e329f1d2c80d97e30e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 363.6 kB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
f726dc9a4bf9fe3973e21db4237bd77f6e419e703d9dd8316d6b0c44107cf977
|
|
BLAKE2b-256 checksum How to use checksums |
d79f9f00fc8cfebef654733a48ec28bf81aaac2485800de97280599782228976
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp310-cp310-macosx_10_12_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp310-cp310-macosx_10_12_x86_64.whl |
|---|---|
| Size | 372.2 kB |
| Tags | CPython 3.10 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
da93360e69d292db64243b3939164e094c0894e651a139b60644d1619542b90a
|
|
BLAKE2b-256 checksum How to use checksums |
de47b2afbc5cc9c6bd6211f55339679a14d1674ff338c084cba44af84643a4c4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-none-win_amd64.whl
| Download URL | toktokenizer-0.2.0-cp39-none-win_amd64.whl |
|---|---|
| Size | 238.0 kB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
7cf8ac3b4cd26f71aba46f92b64f643ec757a47d3a7ed61557ac238c5bdfb6ca
|
|
BLAKE2b-256 checksum How to use checksums |
b74815b8f044ac2e041f924b116cc23c99023354b97f5b17370ab365d3c823b7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-none-win32.whl
| Download URL | toktokenizer-0.2.0-cp39-none-win32.whl |
|---|---|
| Size | 232.4 kB |
| Tags | CPython 3.9 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
07fbaada27280274428b138b16f936c83c390d523e749da7cd6943e7db14a4d9
|
|
BLAKE2b-256 checksum How to use checksums |
a08c427447c97a246e4b701356474e009fb8c27a16141d00f7e0dd199e4f7ea5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
ca0845b6f0a761999ffcd63a788f60aded429a91e5bb85ccbdb0d1b468a30f8c
|
|
BLAKE2b-256 checksum How to use checksums |
1967aa0637c86264939eb2ca96213f77a495eeea5309759b997e84dce7a510fc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ IBM System/390x |
|
SHA-256 checksum How to use checksums |
9dc4525fdf7c7f7a4f1bafad125e898625897a5578649c37a3020872e79afa83
|
|
BLAKE2b-256 checksum How to use checksums |
09519817b8f6322cae509e865ad3f4aef6134ca6bbfe3b594bc0e347e26e93fa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
5a6d147b943528c4117a96cc924460014532d9c4a332361b9d403b38849c3d61
|
|
BLAKE2b-256 checksum How to use checksums |
f04be42226ee7d9af6492356f16f435c5bb25eddc91662ab32a0ba3bc2fe5dea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
c1bb30cd2117551dc46b1c5c00e78ec11e80f9549218941c9dfee4f16596dd93
|
|
BLAKE2b-256 checksum How to use checksums |
78836e56c09df18bf7c7080cc7d72f03719b2868ce9134664a5b16f04eb12206
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
1acc2b168fe6d1489a54bbf91fec99dd8c0b2d6dd11aa69562eaf1c50fdf2f6e
|
|
BLAKE2b-256 checksum How to use checksums |
6813f0024b5b2851b260566706faec4534783bc6f881359e67429929366822dc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
84be565413e2722ff4f45c456656989e8df8a4f88313abdace89cc14a3d5dc43
|
|
BLAKE2b-256 checksum How to use checksums |
93e73549c9f56455af222b339f046137e08b5b2b5d0807b10def8ad8c8da46b6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-macosx_11_0_arm64.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-macosx_11_0_arm64.whl |
|---|---|
| Size | 364.0 kB |
| Tags | CPython 3.9 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
baecec8abb2fe7b42738c4d4943310d931622243b97894c181bed91cf7afe841
|
|
BLAKE2b-256 checksum How to use checksums |
d7906ad98be2ac8e372da125077ba73c5b44753bb8c47f4460e89ec7b986fd70
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp39-cp39-macosx_10_12_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp39-cp39-macosx_10_12_x86_64.whl |
|---|---|
| Size | 372.6 kB |
| Tags | CPython 3.9 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
06ed09a9d618b5d95ffb2c54248497ff4d235fa0c698789bdeb8b1b723442a20
|
|
BLAKE2b-256 checksum How to use checksums |
68d05fc00d1a40be990541ba127d29c56a5c5d6866d94f9dba594fe35efcfc5d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-none-win_amd64.whl
| Download URL | toktokenizer-0.2.0-cp38-none-win_amd64.whl |
|---|---|
| Size | 237.9 kB |
| Tags | CPython 3.8 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d08a5942f9443cd9346ddec7802abd5fdc17d7421aca3dcd89a33b7815822bd1
|
|
BLAKE2b-256 checksum How to use checksums |
59187c1fd5b377ebe833e9bdc644dd000a92fb75adede8435de16e5a259aeac2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-none-win32.whl
| Download URL | toktokenizer-0.2.0-cp38-none-win32.whl |
|---|---|
| Size | 232.9 kB |
| Tags | CPython 3.8 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
13bb7b3b96ffaaae6bd2abd59f38677e1c82470dd977ad3252f4f45863a5b43c
|
|
BLAKE2b-256 checksum How to use checksums |
b290bdaccca83e054c973fcef97aff48d4131ce9ab5cae6a48266edbbd6ff075
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
ec8c71a4a20d5411b9e51da0a86c960d901e210c0b64403fc64d164c72f6ef8f
|
|
BLAKE2b-256 checksum How to use checksums |
d2a2d5231ded9516c43ac499c9331cba0c309944f84909e4b3497083e95496a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ IBM System/390x |
|
SHA-256 checksum How to use checksums |
533d79658b39436075203beeac50bea4f50e76ac21dbbf22780ef36a152ed59c
|
|
BLAKE2b-256 checksum How to use checksums |
e648a8754785ca21ceb54c8502cdc50585362f9711048b7daad4c2858f055df0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ PowerPC 64-le |
|
SHA-256 checksum How to use checksums |
8669b1a6dc055281a803e0c8925f4b01f19ef625521a8cbccb4f67eb34e9c822
|
|
BLAKE2b-256 checksum How to use checksums |
448456e0efc0dca43a9bc7c95ee6c985202654cae4be43993323e218b4eab00f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-32 |
|
SHA-256 checksum How to use checksums |
2e488021c1b9a1a573f87f3e22708950e5617fb8f6ba37657f4c837e4d7ba7af
|
|
BLAKE2b-256 checksum How to use checksums |
d497bf9759ac0c74ac5da0d698153f55d56b074724c53685149f1915b9079e2a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ ARMv7l |
|
SHA-256 checksum How to use checksums |
d96e9e8c75b78686575a8f8f2f9bb8739f4c2c0cf5789b3f15a636c55a6f53ab
|
|
BLAKE2b-256 checksum How to use checksums |
57132eb18a4c49b14a7e22bca24c6404616cd0b68cb7431d953ad4ff80cdaf16
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
Release files / toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | toktokenizer-0.2.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.2 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ ARM64 |
|
SHA-256 checksum How to use checksums |
609303991c8d2da9b6082927ffd97289093c42880a08a3e040efa9d919084148
|
|
BLAKE2b-256 checksum How to use checksums |
a3ed002a58b3f4c555f3fc415aaca2cff46e5a6d4c6fe03fefe054bdd971ff1e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/1.6.0
|
