Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.23.2)

4 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for danieldk from gravatar.com danieldk Avatar for McPotato from gravatar.com McPotato
+1 more Avatar for SBrandeis from gravatar.com SBrandeis

Credits

Author: Anthony MOI <m.anthony.moi@gmail.com>

License

Apache Software License

Requires

Python >=3.7

Provides Extra

testing docs dev

Tags

NLP tokenizer BPE transformer deep learning

Classifiers

Report project as malware

Release files for tokenizers 0.20.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tokenizers 0.20.2
File Size Uploaded
tokenizers-0.20.2.tar.gz 354.8 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for tokenizers 0.20.2
File
tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.10 PyPy 3.10 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.10 PyPy 3.10 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.10 PyPy 3.10 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.10 PyPy 3.10 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.9 PyPy 3.9 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.9 PyPy 3.9 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.9 PyPy 3.9 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.9 PyPy 3.9 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.8 PyPy 3.8 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.8 PyPy 3.8 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.8 PyPy 3.8 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.8 PyPy 3.8 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.7 PyPy 3.7 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.7 PyPy 3.7 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.7 PyPy 3.7 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp313-none-win_amd64.whl 2.4 MB CPython 3.13 none Windows x86-64 Details
tokenizers-0.20.2-cp313-none-win32.whl 2.2 MB CPython 3.13 none Windows x86-32 Details
tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.13 CPython 3.13 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.13 CPython 3.13 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl 2.6 MB CPython 3.13 CPython 3.13 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl 2.7 MB CPython 3.13 CPython 3.13 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp312-none-win_amd64.whl 2.4 MB CPython 3.12 none Windows x86-64 Details
tokenizers-0.20.2-cp312-none-win32.whl 2.2 MB CPython 3.12 none Windows x86-32 Details
tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.12 CPython 3.12 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.12 CPython 3.12 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl 2.6 MB CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl 2.7 MB CPython 3.12 CPython 3.12 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp311-none-win_amd64.whl 2.4 MB CPython 3.11 none Windows x86-64 Details
tokenizers-0.20.2-cp311-none-win32.whl 2.2 MB CPython 3.11 none Windows x86-32 Details
tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.11 CPython 3.11 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.11 CPython 3.11 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl 2.6 MB CPython 3.11 CPython 3.11 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl 2.7 MB CPython 3.11 CPython 3.11 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp310-none-win_amd64.whl 2.4 MB CPython 3.10 none Windows x86-64 Details
tokenizers-0.20.2-cp310-none-win32.whl 2.2 MB CPython 3.10 none Windows x86-32 Details
tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.10 CPython 3.10 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.10 CPython 3.10 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl 2.6 MB CPython 3.10 CPython 3.10 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl 2.7 MB CPython 3.10 CPython 3.10 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp39-none-win_amd64.whl 2.4 MB CPython 3.9 none Windows x86-64 Details
tokenizers-0.20.2-cp39-none-win32.whl 2.2 MB CPython 3.9 none Windows x86-32 Details
tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.9 CPython 3.9 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.9 CPython 3.9 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl 2.6 MB CPython 3.9 CPython 3.9 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl 2.7 MB CPython 3.9 CPython 3.9 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp38-none-win_amd64.whl 2.4 MB CPython 3.8 none Windows x86-64 Details
tokenizers-0.20.2-cp38-none-win32.whl 2.2 MB CPython 3.8 none Windows x86-32 Details
tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.8 CPython 3.8 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.8 CPython 3.8 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl 2.6 MB CPython 3.8 CPython 3.8 macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl 2.7 MB CPython 3.8 CPython 3.8 macOS 10.12+ x86-64 Details
tokenizers-0.20.2-cp37-none-win_amd64.whl 2.4 MB CPython 3.7 none Windows x86-64 Details
tokenizers-0.20.2-cp37-none-win32.whl 2.2 MB CPython 3.7 none Windows x86-32 Details
tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ x86-64 Details
tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ ARM64 Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl 2.6 MB CPython 3.7 CPython 3.7 pymalloc macOS 11.0+ ARM64 Details
tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl 2.7 MB CPython 3.7 CPython 3.7 pymalloc macOS 10.12+ x86-64 Details

Total release size: 451.9 MB

Release files / tokenizers-0.20.2.tar.gz

Download URL tokenizers-0.20.2.tar.gz
Size 354.8 kB
Tags Source
SHA-256 checksum
How to use checksums 		05c95c59b200c2fcf9b2da2d17df9236fb7a6df4136cfb251dfaa8803c0127fd
BLAKE2b-256 checksum
How to use checksums 		9a6e4368d065ab4ab9157a28412df7106f1b2cb7448895059d9f5b6f965689f6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		39b469c53d01d4b01b5f9031f2a37c2f686ccded1e5237a326aa9fedf9cb92b8
BLAKE2b-256 checksum
How to use checksums 		6aae5fb1c3c5c7574e4bb9db271b83d571a279ee8fcddd9a6ac65c318355d362
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		7b5485d33b234ed042b2d3da24edb6f2ad0e8d796a747cdf0af28daf2d57b436
BLAKE2b-256 checksum
How to use checksums 		bc8bb0ae25dae61b1d9c4518b6a894fa3c8a18f6cb7bd12bd2c4602406ec7c1f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		258fb8a23c548192ab117b2286a199ef93bed186b338b5700f4d7f20b6aa36f6
BLAKE2b-256 checksum
How to use checksums 		3062f84df4f7e8f2e5d966ba9bc046d5fe305644b4973aefcb9c56806baaa425
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		625137be04e38208aea6a8b6e458e0ece8d5e96f608f8bcad703f47b4ab72868
BLAKE2b-256 checksum
How to use checksums 		a00f2644edd880ba1de0f1376e993219b9f7b1af972e36527dbd942dbb96b6bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		602ded63e106066969d04ce614c6ad25d432e28ebb16543e7876b30e33cccc5b
BLAKE2b-256 checksum
How to use checksums 		960b88030eb8f39002d5597d594382beaf51d86fad9ef639518811143864a229
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.10 PyPy 3.10 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		97b1e631945cb505407c7cc7b6c34518a6fd82e20c5f6c7d54cba325b7eeba6e
BLAKE2b-256 checksum
How to use checksums 		eb184a0870402a5984ae26296fef596e5049041cba445b84058165082e757403
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.10 PyPy 3.10 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		8c26f5d1bda22dc91c41a6d708e03ded5ee60975d2dda87f79651c74cb2b8829
BLAKE2b-256 checksum
How to use checksums 		2147220647bfe26a39697747889998e549c0818371f5c8dccd81c88e7d88d5d5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		efaa29e985e2a9eff6a8fb2d454ba23dfd82324f04a76e8e193673261fc54ffe
BLAKE2b-256 checksum
How to use checksums 		4ac1fb7c303ae7ecab336c299c2c82667ce8e30606b55fe1ed9e6e144c96dbdf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		0e0d0b6814a2285323fe669d2da5614fdb999b4b5d963d964f6fc8092065447d
BLAKE2b-256 checksum
How to use checksums 		d8d2781b0ae806bd58d4c102b857944cc8f06bdc5d2d45a284b73199ac2eee65
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		efbef80ef87459fffe3c615ba393b185ebe1e3069083b7619549d3d22dd08ba2
BLAKE2b-256 checksum
How to use checksums 		da0206ba0cac76a47fd2338ef65af9d35ee322001b8431d7a48e5d844c3e7fa3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		cdefc3e44ff71e36b116d6b152344666212a07b91129ce41b667687869a7a3f4
BLAKE2b-256 checksum
How to use checksums 		b93fdc62ffcc0d877c6839629cd36841838cdcd4f4623aacdd7f756eddd8678a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		0912a257b67053d070f9dd539befbcf0f9e6d86f456d099f7c30750dad6985ac
BLAKE2b-256 checksum
How to use checksums 		db37bad383b7f92221e3394eda9856c6cd07403b8e312501ec74dad672e20bcd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.9 PyPy 3.9 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		6ca7781d98858825ebe84d2ce692b1c4de5ec45733d30dd3a9398e804e79c8ae
BLAKE2b-256 checksum
How to use checksums 		209087ae7498fa627a3dcfba04bbc77339ca621c2518ac3a71f508fc38040f81
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.9 PyPy 3.9 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		477eaca81c233612f0a4eba2f90c1eb584ed6cb845f1f48e1a4374220dae6891
BLAKE2b-256 checksum
How to use checksums 		39a8d1257272d556038d4f299c302be28892939bf8854f9d77cef26d93165567
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		bf69a9f201ccd8409f1ab265899ac64ec672ac9148bd048f365ed5b39758a697
BLAKE2b-256 checksum
How to use checksums 		a51c4553481a1320235c25fb589efa670b8e61207c4f60a12776dc31223d4f83
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		6b7d6584b73fbc54cb93e960acc504f9a02b8cd3e9fcf664f5ed9213b4ea5a32
BLAKE2b-256 checksum
How to use checksums 		e5358004f925297548ca25b3109aeeea77f4f9ca1f9b6403d491aed0df04af21
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		300b6c814ec0e2ee086861632a9c4bfc9c6497aa8521be93e421deb3e35b6516
BLAKE2b-256 checksum
How to use checksums 		e33af60ad3601c9cf3748cee2a0909b86b8b77a033d30ccc35bed0aa152d22d6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		c89ac11bb920e5cac941537aded586b2ea70e1e34de2c8b8c08c87bdc143f8af
BLAKE2b-256 checksum
How to use checksums 		6b7be065141bd3806253bbde00b68264ba625b0066388c8c97699d8642aab4d8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		2b19540a4a478df61270a55af4b78d2ef995f751d2ec07dee72aadb93c23e249
BLAKE2b-256 checksum
How to use checksums 		e2f52399f0f153e1bfca23b14d72545a2d0ff7cac64dacd198d880c54df31e5d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.8 PyPy 3.8 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		7438d992e9816b52e1e60967bea71fe03f6966a7e5946358cec6b43fb6588df9
BLAKE2b-256 checksum
How to use checksums 		f5974ffd6f0d431807554d3806dcdf2ce1be5b98194d09268ca260a814db7a90
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.8 PyPy 3.8 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		85b19ceb27994a03db4d13e568eb70e50354b3d3d364c95ba44fb5d56ca37d8a
BLAKE2b-256 checksum
How to use checksums 		790c48405916a3f96abccf2052cf424ddbe921760ab4f496c866b78d45b133dc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		4bc6acea6d541614c42f9a689aef63a765c12aeccecf4fc34d8606c41d66cdbf
BLAKE2b-256 checksum
How to use checksums 		e4f4f1f49bb6242c41113af47db83ce33a52a9af23daf7671ef79eea4f8e4b89
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		b7ac0e0075de89be1310cd30d13e6587af8c3a0f951096fe4f079fece4cba7a9
BLAKE2b-256 checksum
How to use checksums 		1ed99a638b8d78f4b2b104ec6bdd36314463db8dcb8e346e06707c574d784d85
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		0c3e02f718163947da345bf52a4396f037d7b773118a0d03ed9e87e1a26c100d
BLAKE2b-256 checksum
How to use checksums 		f1a0b85bfc7c5d230dc007a4469d5462615f23fb0a29e3f867f01072135783a9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		a5ac72c3fb1387a1c2ed77a755c1b2c5188e0e995620051aec987540c5ae0e2b
BLAKE2b-256 checksum
How to use checksums 		8341d3e5227ced454ed56c0a53811cd90233c2160a6c23d5fc5e6f751534402d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		69edc940db9510790d8642c7ca3fe40d4b6645ded943f8d7641ee77d4926534a
BLAKE2b-256 checksum
How to use checksums 		714e858de1f8d6b6308a9e3d9d9c847aa5ea6942830bb15da4e06c408489de9e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.7 PyPy 3.7 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		4498d7e06123521d7fba85fc8cb9509591ed2f6fd8cb57fa238eebb420d11a1f
BLAKE2b-256 checksum
How to use checksums 		12e2183b927b0c0dd7e986d4788c52b2cc0867da88f5962d910b978be21d82ca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp313-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums 		ee4a89d33a39bfa9e24a7bd74df3cafcd23f45142e51ea0226cf4f63f7292854
BLAKE2b-256 checksum
How to use checksums 		47b08fccf62667d7238cb3e3ee05246787f3b7317892ef58b17628a8983a9d94
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-none-win32.whl

Download URL tokenizers-0.20.2-cp313-none-win32.whl
Size 2.2 MB
Tags CPython 3.13 Windows x86-32
SHA-256 checksum
How to use checksums 		68576b8cfaadcb43384ba70b98b12f566c50843a5ed1c48237c086ad6cfaa93a
BLAKE2b-256 checksum
How to use checksums 		2347b118a9fa93a69500466abb84d3a161b887a183177e0d18ee6a8f2300459b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.13 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		ef33b0ffc41bfa6473103d16995e0a71b65a21b09f013f0872d119c251e95639
BLAKE2b-256 checksum
How to use checksums 		3434841bc2a9e873d6addbabbe8437d3c92e7b7f3c398c2f911124cd1db18e57
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.13 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		ae4924d8596565470106b859be577734d75fdd2911d2dd266fcd7dbf4da7c193
BLAKE2b-256 checksum
How to use checksums 		071d8bd0e13d092d2eb4fc83fdbfa3492459b0a4379aaab6e29aba1fa3f73838
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.13 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		eab036b5a5e36559d9e91cdc4a517badfdba6e91f1047485b9c8906810fd68a1
BLAKE2b-256 checksum
How to use checksums 		ec7d68ab3210bccca803fd1c15f262f64448166f6a44775ea3b0641246dc20d3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.13 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		4573bb25b93d359869a867bd9cfb5896a86b9c2b9a9ca81956c5dfe891667774
BLAKE2b-256 checksum
How to use checksums 		26418f11f56e7e4ab1895f392a3ac65c559bad1c69a433b06359172c932e4805
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.13 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		02d450342011c18a8b5324ff97c42a325a10a1ce5ab097313fad829cbe89fcef
BLAKE2b-256 checksum
How to use checksums 		9892e7e06f7361197fa36598c326d85c21d75e814ea942c2a0e5e9a603dc125c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.13 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		9a074fefd2874458dedafd450a7c74c075f0bf20f15172e8b6692c4aaab6e0dc
BLAKE2b-256 checksum
How to use checksums 		5c0e76b860c42cfce45ca6dc1458bacb31dfc78826b9c49f78b8faf515b832bc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.13 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		f49a325322ec52aecda02847b9dc1fd190f9352e45ad16ff438fd7634ba6376d
BLAKE2b-256 checksum
How to use checksums 		c32ccc6e7bc4c2fd2e92a42c0f824c7eb9fcb6185d1c3b1c836216ecf4c978e1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.13 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		c58cc2ca193018455618a27e165220f36aa83efe39e051cf976a5502a9a9b799
BLAKE2b-256 checksum
How to use checksums 		94a36c1096fc0780b5cc7a70bd5078ebc44ee2a64fc852f51858049dfc39532d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		1ccef0ae85121b6c0d07e05cb77fe29842b29dd5b48abf0d340bfff8ce3f463b
BLAKE2b-256 checksum
How to use checksums 		70ac937a046d1a9d756e37ddf83b38539f8c56ff71ce46b8a713c89cdd549a94
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.13 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		2643fee18919da76f498214e253ae7409a61f02823814d8a4486624d8a7b3706
BLAKE2b-256 checksum
How to use checksums 		db720f30cc2b397ac1a6dcc5c9c00ca5889af73d4e98078082bfe3d34fffb53b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp312-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums 		4dcce9e042e5b80e056beacd2e97a344316c29965e7f00b82f658ba08b9870cf
BLAKE2b-256 checksum
How to use checksums 		18be203a41a5d65ae982196b7d5984cf9a076374f4edee05cc57254db3979f78
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-none-win32.whl

Download URL tokenizers-0.20.2-cp312-none-win32.whl
Size 2.2 MB
Tags CPython 3.12 Windows x86-32
SHA-256 checksum
How to use checksums 		f8d77aaefc4a4f23cfdedae2e28e5c99b301734ea57fc510de5c192408601b9b
BLAKE2b-256 checksum
How to use checksums 		8614598e8310f4ffc61f32416c91627ec976e0194300d0ecf36eecc30a7b4464
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.12 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		3d1711852ba36a8944a76213543790e854d422e81b99ca678b4995d0d6accc44
BLAKE2b-256 checksum
How to use checksums 		54ff71b92166744e5cb20cd57d318a0931626b86960f176d1bf3eca5cca5011a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.12 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		1b8cf59f36c51a549a4d9c7b06d902bba5434c46ad2c8209e5512ac1e42ca348
BLAKE2b-256 checksum
How to use checksums 		1bf43fa79b823cb6bfa8986dcd5a8baf709eeb5f30aa493b1f76f57c2ae6fb3d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.12 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		6818ff76e51aa3bc7b358debffceaeb8b6827720083ceec026afadb3f44a9744
BLAKE2b-256 checksum
How to use checksums 		ecac6b5d676438e850f74804644642dbeba338bd1b20cefedd4a2fc3bb8bc9e1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.12 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		143b8015b2ece56cd31116bbffb96ba20d6bbb64407daed0fc8a146ec858045d
BLAKE2b-256 checksum
How to use checksums 		7d73b24f6705eefb0ae0794a67b716271377275e8e02ce09f81043da049ad594
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.12 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		61383c265696215bfbf50175663076a8e4c3dc48a82022f86c26f9b2d9650b6e
BLAKE2b-256 checksum
How to use checksums 		15cf52bcc5cb7522f267960c2a466d95d8a0ced2188e3977ba3b15aa331aca7c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.12 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		35a51898c0953f501b402e7219aec157a66e750349a9fbd35a337f8813654b33
BLAKE2b-256 checksum
How to use checksums 		d7c227646e0e21bc3470a604dbb870a23f70acc669aa666c26164627e046c59f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.12 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		dc485a81f260d2673cfde202327c611b627c5da33ee363254767bf7a7618aa94
BLAKE2b-256 checksum
How to use checksums 		93a07909fda1421b7732d8230818e7cb6cb045bcc01135244c4c13f341e80df4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.12 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		075d933b283e8aa07007f420e79876cf38f266dcecf617225b530aa17fb842f9
BLAKE2b-256 checksum
How to use checksums 		c41083d577a97ba026975d33387b81bf95d10547a0dffec972badf6061aff64e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		a90476820f64dc0e7fe9469eebf4dcdaa2bebebbe8f9b69bc74cbd9b08256427
BLAKE2b-256 checksum
How to use checksums 		4abef0691a2a95635f87d8c623247862beeba59798979cb8673922e72101839d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.12 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		ae574dd21ddef77163e9bdf65b0d61d41eb435a11ae545c92d1bb1d2aebfd9eb
BLAKE2b-256 checksum
How to use checksums 		2a8ff10b70d8cc76d44d313e56735774add1f41a82d50a0f6d6bf3d06ffa6607
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp311-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums 		0427b592f9be8a8377602fa8996508c4d5fed6aa07971f4a866ef21ed6137dea
BLAKE2b-256 checksum
How to use checksums 		a46403ee288a2243e24a14891c969ab85de2593c938f72d0ae8083bdfefd150e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-none-win32.whl

Download URL tokenizers-0.20.2-cp311-none-win32.whl
Size 2.2 MB
Tags CPython 3.11 Windows x86-32
SHA-256 checksum
How to use checksums 		a12ddc02cd8db6c3f6a66faf1e23e065f6ec50a1ff93077cc0ee526a60225cc0
BLAKE2b-256 checksum
How to use checksums 		8900379ba1dfb40e4eaed40cfbaa9a598c42a65db2c8da85b53e9171c52b0be0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.11 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		04d4010d3e5fb0c4c98060fb6ecbe42ca67a91b4eab2ddda2749b8ec18ac952c
BLAKE2b-256 checksum
How to use checksums 		6c653bd23450a5b4c86ea055c1c66d10a61112c86631e0f712c14c32bd51febb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.11 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		625ac108243a714bb8d099927d3723b01a03b258ef44af04c6d65620d19c9527
BLAKE2b-256 checksum
How to use checksums 		4106604f3daf944e1a714987e606937b70450b3572bbc5f4fd25d6ee308f67a4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.11 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		bd8dea683e84f795bb69ab822ef5b83921f22e6d9ef3ca7135ce35ba82d55249
BLAKE2b-256 checksum
How to use checksums 		b877f26202ffa017be7d814b8c7dc561752092cf79b1a14995a1d87daca301ed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.11 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		d95091c6f74f1c4f28a962d923442e492fe88ac3224c11daa999da438320eaa1
BLAKE2b-256 checksum
How to use checksums 		21e94b45c32728e3fc96f86a2e9be6bf9efee00c7a8c396c8c0343444b3e7eb3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.11 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		43011f17b2544d9dfe3f1fd3e8acf9e6bec29147e7e166c405ecd4ae79994a7e
BLAKE2b-256 checksum
How to use checksums 		bcb25fe35ca4d8f54421b20a37c678626c92a44d7eb1f18b51c249c5ef39459c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.11 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		19b888bece6ff5ed6834551f7043f4b55f0535b2911dcc655733f7009c177e4a
BLAKE2b-256 checksum
How to use checksums 		be952790b2ca1fba797e7ea04929012d0ebeb45786c1eff0806f37c496d93ccd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.11 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		0b91272d52e37367be87c06074db1e70f92ed4b997ad9a9422ad24bbeb50410c
BLAKE2b-256 checksum
How to use checksums 		468bf89585726af54f70bd483dac7758927f81f440d4c963fa9248c1b8360030
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.11 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		f57f4c0206048d561226879c04d43c78a360a919be305b9dc3e64c5e4103744b
BLAKE2b-256 checksum
How to use checksums 		2d13828aa9dab9657ac483ffe14be1b2747d8b564ccd660f34f235b86ace30b2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		90808ce914e6aeea8d14db7119eedb591998493467c7b34929a9dc9b29ef5fab
BLAKE2b-256 checksum
How to use checksums 		162d1ab522c7a9ebf2894dcabacea698eb7c667f5999ed4109c42602d4932918
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.11 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		b072bc2f125936ba6a86a4c8604696cd5bd1bb2dbd1fec4cce0f194f2dfad04d
BLAKE2b-256 checksum
How to use checksums 		4a45fe3664a7cdfad069160dcfa6678c95c2e8a204cef430194011070645e27b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp310-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.10 Windows x86-64
SHA-256 checksum
How to use checksums 		0f1da11ead494c62ab7da17a649f2ea2de468198bcf8e3b902ce7aaf8c6f42ce
BLAKE2b-256 checksum
How to use checksums 		af09ee7c5e54ba76bde477613c9df1fe5818ea410c69e237a088d6387fef080c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-none-win32.whl

Download URL tokenizers-0.20.2-cp310-none-win32.whl
Size 2.2 MB
Tags CPython 3.10 Windows x86-32
SHA-256 checksum
How to use checksums 		7b397bd0eb8dc871983669e2cb15b3913f7f23af3ea98dc07bd48cc11a8bdbe9
BLAKE2b-256 checksum
How to use checksums 		90dc8a2812bc52810a28e4ded850c3188b06f661905ad1372e6796b1d243ecb7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.10 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		b52f19163f790870b4d9e4dfa0f7a4c75a372e0dffb80537efe652d6b3ab8c96
BLAKE2b-256 checksum
How to use checksums 		a24a812aa45a06baade752093a924c1a73110c19603e92c3f68631225938c6e0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.10 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		0dd4f1f0d2c141ad7c0736677b3d2e5437e5ecd1e73e3e1f3f24c12db83646a9
BLAKE2b-256 checksum
How to use checksums 		ee1c922f702d1ae96f35c8db30927ff90e7694892f4e22d2e11301ca170eac2b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		93cf8fb1dc7244b1595eecffbd018400c437c7e092e3075452b3e4225e90b1df
BLAKE2b-256 checksum
How to use checksums 		e4bbc24bf78f51629062868f47fee9ac53d592eed6ed4473b0f97602189bef2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.10 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		58defb199ce5708626e5dcafffd108c3b5eeb170d9a473382e40f7ea6362d786
BLAKE2b-256 checksum
How to use checksums 		7c1d46b647703f354a58be1f982e0208548fe041488e8529ae3f44b1da7c0f73
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.10 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		858cf33522c6d8d4f35f28fca06e9ec735d577ed05881c6df9c51068b4c3abee
BLAKE2b-256 checksum
How to use checksums 		aa3113910f8f87d54c94a41a896c4d99ee41ef4c0d5a8f23522ddd103c73a29e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		cf7b25d1098130a73806037d4370f946ff8cbc68025e1e37c2122eecd199de22
BLAKE2b-256 checksum
How to use checksums 		f10563c3aa507499328e00ca4ab2a6966806b5ac4a3cd18b0654435aa05021c7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.10 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		6b0d77497dc8f619a3cae519116c8d23c07fd3cf9cc62ca8dad6140f490aa282
BLAKE2b-256 checksum
How to use checksums 		58e192c12746935ad99e4f760d4605b4a6bd67b73a7711f0b3fb34c34527fb29
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		12e87dd9eb607685423396b1c87f035658b6ea594c07a144378e2d63a10b90b5
BLAKE2b-256 checksum
How to use checksums 		0b0e775eb6d9bd8a7f1a97ff480778e6383910a02da19c009486732b4bca8574
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		cd34334d90663bc7a6d6cb5fd4bc667687cd016e92b2624086ea03830221c489
BLAKE2b-256 checksum
How to use checksums 		19fba4887001bf3be897e37f01a42295c08269e514a8579df9772dfe58aad3fc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.10 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		dce8801285a2cd8eea906d8bede3c6a92bfc79a9a6bf164cc69940586e2aee97
BLAKE2b-256 checksum
How to use checksums 		142bae0b948eacb0f3d15ac19a6e8a7cae2a173e33c1f6a3c4abcbab6e76ef97
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp39-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.9 Windows x86-64
SHA-256 checksum
How to use checksums 		a6926bc2692f7ded544fed1a1596b7b22eee9590afc284696421e745b5bcb65d
BLAKE2b-256 checksum
How to use checksums 		3a0aa81c48732045398cc621c9f06ae884703c56017ee818d83aecb50bf8d759
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-none-win32.whl

Download URL tokenizers-0.20.2-cp39-none-win32.whl
Size 2.2 MB
Tags CPython 3.9 Windows x86-32
SHA-256 checksum
How to use checksums 		1203e8d0adb0b36d2494c084a35ba8afa52e0735ce3e86aab033aec9e65164cd
BLAKE2b-256 checksum
How to use checksums 		7bbe654db960127285d010d063d34197a36f8f27a7981077a58b95a53ed8d0a0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.9 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		e4c9656d1f985c274208ff9dcbe7c9c2bbb328457a27508f6044e468f6137c9a
BLAKE2b-256 checksum
How to use checksums 		ec32d400eabb3516ebe51aefe4931d52a43a1ba9dcd56ab2433908641c685250
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.9 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		eade373618be551b962d55818c978289eab58376073ceb4339554df1ef550d08
BLAKE2b-256 checksum
How to use checksums 		1ef076b0a0d6b048e6f5e7a33b08d7448e976c58b499f6d743462b36e0ce088d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.9 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		1265baa0190729f83e5857fbee31842c96c4fc8a1ad7003e055c7560ad2885fe
BLAKE2b-256 checksum
How to use checksums 		1511663b52766ce0b5298b61ec7fe9d28cc1ec8871418ff75fdb9d2fec2d74b3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.9 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		6b4c610a1b740539872257a76d3308ef1e84936a1cb11223268b8505ee023f23
BLAKE2b-256 checksum
How to use checksums 		250fcd28ccbc7a4daa2dd88b3bf29a3cf16994b9f8df0ac32b809d3a8bf45ac4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.9 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		165c63342671df3c792ab3f4c5b763b2a5e73257e7faeab2767675929fe05853
BLAKE2b-256 checksum
How to use checksums 		2229603c8cdfabc5a7dbe27199b7f11fb8d2410427d3b42fd8498ae6aa8d4dd1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.9 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		520c69ca7a6e108a6ca7ed8b5fd5e23eac37ca9bc0788892b41065184564337d
BLAKE2b-256 checksum
How to use checksums 		d20f2089402d03779bac7ed24636c8d02ba0f63151d482b00796bb5ecfc66a8f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.9 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		2e2404ffdf47b59e54c902055ff7e83b955a6bddaa1f09f4330c772d9b60f284
BLAKE2b-256 checksum
How to use checksums 		89e3d37cd10ab74de64f0df88e241d632af80a3cfd9f528cedb49f1754b96132
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.9 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		2a4fe4d9c68e29274dde8b6ed56c83a12df8164f4f7a2a8c6edc20c5124aa65a
BLAKE2b-256 checksum
How to use checksums 		7b581c4eb8e66f038dcc1412139b27f73a750ed9b1835725488bd055a7318f90
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		ad42cca87d7a8c69c3995d53d473e14c160fcdf9cedfe91092b458f2aa1d2c84
BLAKE2b-256 checksum
How to use checksums 		aa5e380d0f809c1436dea9688f4cb99f8dbf9fe5e372c70b4a33bb1635d6c379
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.9 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		f2512fd654af3d8316524767b18c2548226b01fe6d79f559ef200d95488e8187
BLAKE2b-256 checksum
How to use checksums 		8707a172e2ecf6825ac6f639a0d0a1646ae3c702b88674045bd712de47562890
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp38-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.8 Windows x86-64
SHA-256 checksum
How to use checksums 		871cac55ac333674254d476d75d22855aec6a16c4939a7d455317e447afda00c
BLAKE2b-256 checksum
How to use checksums 		f3dc62f49c9dc1a51923a8ec516eb9d05212b978142e524a8a44913a8ed690dd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-none-win32.whl

Download URL tokenizers-0.20.2-cp38-none-win32.whl
Size 2.2 MB
Tags CPython 3.8 Windows x86-32
SHA-256 checksum
How to use checksums 		5b8c4afd7816d836ceeec990855f65b115e7a39dbbd26bdfa20b360a43b4d35e
BLAKE2b-256 checksum
How to use checksums 		ac6cbc35873f2beb98e3c1ccaceddb42474e6c74a71f26a26bf33a513fbd57b0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.8 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		97a2294588de369008337864a466e9637729445a7261c6ae3e9de9bcd4f17721
BLAKE2b-256 checksum
How to use checksums 		942002b71f9844d1ca7eec7e441de13f9ff8ffd6fa39c2117b34d16b85307f67
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.8 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		2daec7c4b2b99a2d4cf1ce83616432dbb2480d784b6a3a5a28aabb8a91665378
BLAKE2b-256 checksum
How to use checksums 		08efd2c0d7523e5c2268b7c661b742b22f74f6a1bba05f81e8c8a59a6afdc7c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		4cca5de082aa78850d6c2528abc9a076110bdbdd9873399c2c4bb4d3704574b0
BLAKE2b-256 checksum
How to use checksums 		48f377c2396a1627a22b9b67618b326d1c3a96a2499fc4606e98a1066df61173
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.8 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		4db2aa974374ce87aa7bfea3573a4d006e31c8d093be12bccd25f29e1551b245
BLAKE2b-256 checksum
How to use checksums 		44a34f53f58505da786bd459d33a2ce69264428548fd31f6ce0458a9c7d3d0d4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.8 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		6d9b0099662a1e555cf3c7341c54c831e7f4394c953b7d93bfe0786c3a9fe7fd
BLAKE2b-256 checksum
How to use checksums 		f7dc3f449194a52ef477703f46432ef02be3aa114ba8be7c6bca677deff95b3a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		23e023e89382d54f721c2bae19f37e5abef8d43739c0625d3a28f9c5b0565b13
BLAKE2b-256 checksum
How to use checksums 		c10463eb00cf9ebbf824b748fe0a5a3fe70133579eadb71e5ddce7f546f2e073
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.8 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		04b80dda85dc4ca2cc26c736490a116da02a48d54835d6f358496b12fe201fd5
BLAKE2b-256 checksum
How to use checksums 		a3e54564be827d0cc3968962059857dae2e04175e2b1ff600d1e553990efb82c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.8 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		fa64548c61de8b7fccb53fcfa82935f77726bc6a50518dff88efa6e5fd56aae0
BLAKE2b-256 checksum
How to use checksums 		ce5c37e43f5f9be831ddb28c3b84fd678a8e299ca2d4b2e92054b4606036274e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.8 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		845107fb7da8fb3fab988bde10d323f70d46a2e8a4585aaadacf7e3a0cb6fd89
BLAKE2b-256 checksum
How to use checksums 		d20b41d11b987d734e4fb7e26169effa905360fc57a32a45e885ec5e099e54f7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.8 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		43c00dba54b30736a444fb302d205e34fe079e2845d989f796f1b13295e7ef71
BLAKE2b-256 checksum
How to use checksums 		353fa1c2036c931287f0d314b47ab2ba7287d6aa39a41b6e307e37311d9ea246
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-none-win_amd64.whl

Download URL tokenizers-0.20.2-cp37-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.7 Windows x86-64
SHA-256 checksum
How to use checksums 		340ad77d916590f07e0ea0a536a769c61c570c35893094268621eda7d7bc125d
BLAKE2b-256 checksum
How to use checksums 		91a3b2fc362218c5244069ee72423f95c695d897148bd1d9d60af536394bd273
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-none-win32.whl

Download URL tokenizers-0.20.2-cp37-none-win32.whl
Size 2.2 MB
Tags CPython 3.7 Windows x86-32
SHA-256 checksum
How to use checksums 		0cb864f0fcb59a82b27168a3e28dd47df6fef9449424b1c63af0c3239ef90d97
BLAKE2b-256 checksum
How to use checksums 		2e7c4fcf68503189a0c8ebe42b6ccd963a7f424261409c19a8952b90c4707728
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		b9ad4b4954b06d5a7f31cec1a2815bc02303de45d907b1d5372cb35f9bd26e88
BLAKE2b-256 checksum
How to use checksums 		d425cde00d1b44b90140c800f2ab33232d7cae8d69de25ee23fc1342c3a0031f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		d1d791190fd55b3c6243e888c7206830bdd0e0c3ef61a21fe9577d72406266bf
BLAKE2b-256 checksum
How to use checksums 		0c88c743d22410416b7c3edc7e8f2edfadf428040eb88303d3168e44808ab655
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		dd7bf1c8bc0f5103cf1f31988f63c46d30056b9d7a5191691c4cf9c7cd888bb6
BLAKE2b-256 checksum
How to use checksums 		6a6eca079cc831d2d11f2ff8d9984d9fba110f6ad01d632db9b81d7380d598b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		9f8be47b38456376b4e067334ad09d2ec6142a34872b0f95e2a63a38d068d38a
BLAKE2b-256 checksum
How to use checksums 		01c5653f2d341dfc6f0479ac6bfee1aeea2891ae66d6ceea5c424bfb810b2aed
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		bc55370604ade0a8cca9bd2351489c39e13ae34210a2adfa3e78ddebaf0a4102
BLAKE2b-256 checksum
How to use checksums 		ace42316222ce80d6d0bb0f47e75104c2d1271e3527b2a9e99b900b56b8084ca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		64d5bd597e1f64112c1c3c8c7058b6d35f95e7ef6dfacc80e00963527082f45e
BLAKE2b-256 checksum
How to use checksums 		d84bef6ad077dc3a7765bf80705389f1e658127985772400f06a3109b5dee216
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		ca9dd9291e126879bcbe35b95861b8152312d230a1a491d4026828aa6b58730f
BLAKE2b-256 checksum
How to use checksums 		ac9be5c916be3735c1bba00b4dc6d5e2ccbf84b2b2d7441daf5ec8e8d4540d9b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		2121bdf9461aa522e4e324d71cfcbb1a99cc8ec5aa817438ea0aac996b14d4b3
BLAKE2b-256 checksum
How to use checksums 		497ae97588c138b39e325df9837512063ed7140e2ece0033d5b3bf90cac8d0b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		dd4eafddbdc8ae2d01115d7731907b75f80110cb5dcabaab46facd19d881451a
BLAKE2b-256 checksum
How to use checksums 		5e263dac32b1954793d2482687cdf2b1384a4493152a1e6322fee2faff8e4b56
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release files / tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		b33e077d00200c40248f69b437ab95959155fbf3e199bb70f24cc54b5e5b33d0
BLAKE2b-256 checksum
How to use checksums 		208a201f9b7dc0e22ea4ac38be165c5031fc39ca0b7e867b10ff3f3ec8e22120
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.12.7

Release history Release notifications | RSS feed

Pre-release

1.0.0rc2

24 release files

Pre-release

1.0.0rc1

24 release files

0.23.2

17 release files

0.23.1

17 release files

Pre-release

0.23.1rc0

17 release files

Pre-release

0.23.0rc0

17 release files

0.22.2

24 release files

Pre-release

0.22.2rc0

22 release files

0.22.1

15 release files

Pre-release

0.22.1rc0

15 release files

0.22.0

15 release files

Pre-release

0.22.0rc0

4 release files

0.21.4

15 release files

0.21.2

15 release files

Pre-release

0.21.2rc0

15 release files

0.21.1

15 release files

Pre-release

0.21.1rc0

15 release files

0.21.0

15 release files

Pre-release

0.21.0rc0

15 release files

Yanked

0.20.4

15 release files

Yanked reason: Removing support for python3.7 and 3.8 is breaking and is move to v0.21.0

Pre-release

0.20.4rc0

15 release files

0.20.3

112 release files

This release

0.20.2 This release

112 release files

0.20.1

100 release files

0.20.0

100 release files

0.19.1

100 release files

0.19.0

100 release files

0.15.2

110 release files

0.15.1

110 release files

0.15.0

98 release files

0.14.1

98 release files

0.14.0

98 release files

0.13.3

40 release files

0.13.2

40 release files

0.13.1

31 release files

0.13.0

31 release files

0.12.1

33 release files

Yanked

0.12.0

33 release files

Yanked reason: Breaking change with unexpected effect

0.11.6

38 release files

0.11.5

33 release files

0.11.4

29 release files

0.11.3

29 release files

0.11.2

26 release files

0.11.1

26 release files

0.11.0

26 release files

0.10.3

17 release files

0.10.2

41 release files

0.10.1

41 release files

0.10.0

41 release files

Pre-release

0.10.0rc1

41 release files

0.9.4

41 release files

0.9.3

17 release files

0.9.2

17 release files

0.9.1

17 release files

0.9.0

17 release files

Pre-release

0.9.0rc2

17 release files

Pre-release

0.9.0rc1

17 release files

Pre-release

0.9.0.dev4

17 release files

Pre-release

0.9.0.dev3

17 release files

Pre-release

0.9.0.dev2

17 release files

Pre-release

0.9.0.dev1

17 release files

Pre-release

0.9.0.dev0

17 release files

0.8.1

17 release files

Pre-release

0.8.1rc2

17 release files

Pre-release

0.8.1rc1

17 release files

0.8.0

17 release files

Pre-release

0.8.0rc4

17 release files

Pre-release

0.8.0rc3

17 release files

Pre-release

0.8.0rc2

17 release files

Pre-release

0.8.0rc1

17 release files

Pre-release

0.8.0.dev2

17 release files

Pre-release

0.8.0.dev1

17 release files

Pre-release

0.8.0.dev0

17 release files

0.7.0

17 release files

Pre-release

0.7.0rc7

17 release files

Pre-release

0.7.0rc6

17 release files

Pre-release

0.7.0rc5

17 release files

Pre-release

0.7.0rc4

17 release files

0.6.0

17 release files

0.5.2

13 release files

0.5.1

13 release files

0.5.0

13 release files

0.4.2

13 release files

0.4.1

13 release files

0.4.0

13 release files

0.3.0

13 release files

0.2.1

13 release files

0.2.0

13 release files

0.1.1

13 release files

0.1.0

13 release files

0.0.13

13 release files

0.0.12

13 release files

0.0.11

13 release files

0.0.10

13 release files

0.0.9

13 release files

0.0.8

13 release files

0.0.7

13 release files

0.0.6

13 release files

0.0.5

13 release files

0.0.4

13 release files

0.0.3

13 release files

0.0.2

13 release files

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page