Build GitHub


Tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Bindings over the Rust implementation. If you are interested in the High-level design, you can go check it there.

Otherwise, let's dive in!

Main features:

  • Train new vocabularies and tokenize using 4 pre-made tokenizers (Bert WordPiece and the 3 most common BPE versions).
  • Extremely fast (both training and tokenization), thanks to the Rust implementation. Takes less than 20 seconds to tokenize a GB of text on a server's CPU.
  • Easy to use, but also extremely versatile.
  • Designed for research and production.
  • Normalization comes with alignments tracking. It's always possible to get the part of the original sentence that corresponds to a given token.
  • Does all the pre-processing: Truncate, Pad, add the special tokens your model needs.

Installation

With pip:

pip install tokenizers

From sources:

To use this method, you need to have the Rust installed:

# Install with:
curl https://sh.rustup.rs -sSf | sh -s -- -y
export PATH="$HOME/.cargo/bin:$PATH"

Once Rust is installed, you can compile doing the following

git clone https://github.com/huggingface/tokenizers
cd tokenizers/bindings/python

# Create a virtual env (you can use yours as well)
python -m venv .env
source .env/bin/activate

# Install `tokenizers` in the current virtual env
pip install -e .

Load a pretrained tokenizer from the Hub

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_pretrained("bert-base-cased")

Using the provided Tokenizers

We provide some pre-build tokenizers to cover the most common cases. You can easily load one of these using some vocab.json and merges.txt files:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
vocab = "./path/to/vocab.json"
merges = "./path/to/merges.txt"
tokenizer = CharBPETokenizer(vocab, merges)

# And then encode:
encoded = tokenizer.encode("I can feel the magic, can you?")
print(encoded.ids)
print(encoded.tokens)

And you can train them just as simply:

from tokenizers import CharBPETokenizer

# Initialize a tokenizer
tokenizer = CharBPETokenizer()

# Then train it!
tokenizer.train([ "./path/to/files/1.txt", "./path/to/files/2.txt" ])

# Now, let's use it:
encoded = tokenizer.encode("I can feel the magic, can you?")

# And finally save it somewhere
tokenizer.save("./path/to/directory/my-bpe.tokenizer.json")

Provided Tokenizers

  • CharBPETokenizer: The original BPE
  • ByteLevelBPETokenizer: The byte level version of the BPE
  • SentencePieceBPETokenizer: A BPE implementation compatible with the one used by SentencePiece
  • BertWordPieceTokenizer: The famous Bert tokenizer, using WordPiece

All of these can be used and trained as explained above!

Build your own

Whenever these provided tokenizers don't give you enough freedom, you can build your own tokenizer, by putting all the different parts you need together. You can check how we implemented the provided tokenizers and adapt them easily to your own needs.

Building a byte-level BPE

Here is an example showing how to build your own byte-level BPE by putting all the different pieces together, and then saving it to a single file:

from tokenizers import Tokenizer, models, pre_tokenizers, decoders, trainers, processors

# Initialize a tokenizer
tokenizer = Tokenizer(models.BPE())

# Customize pre-tokenization and decoding
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(add_prefix_space=True)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.ByteLevel(trim_offsets=True)

# And then train
trainer = trainers.BpeTrainer(
    vocab_size=20000,
    min_frequency=2,
    initial_alphabet=pre_tokenizers.ByteLevel.alphabet()
)
tokenizer.train([
    "./path/to/dataset/1.txt",
    "./path/to/dataset/2.txt",
    "./path/to/dataset/3.txt"
], trainer=trainer)

# And Save it
tokenizer.save("byte-level-bpe.tokenizer.json", pretty=True)

Now, when you want to use this tokenizer, this is as simple as:

from tokenizers import Tokenizer

tokenizer = Tokenizer.from_file("byte-level-bpe.tokenizer.json")

encoded = tokenizer.encode("I can feel the magic, can you?")

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.23.2)

4 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for danieldk from gravatar.com danieldk Avatar for McPotato from gravatar.com McPotato
+1 more Avatar for SBrandeis from gravatar.com SBrandeis

Credits

Author: Anthony MOI <m.anthony.moi@gmail.com>

License

Apache Software License

Requires

Python >=3.7

Provides Extra

testing docs dev

Tags

NLP tokenizer BPE transformer deep learning

Classifiers

Report project as malware

Metadata

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.23.2)

4 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for ArthurZucker from gravatar.com ArthurZucker Avatar for danieldk from gravatar.com danieldk Avatar for McPotato from gravatar.com McPotato
+1 more Avatar for SBrandeis from gravatar.com SBrandeis

Credits

Author: Anthony MOI <m.anthony.moi@gmail.com>

License

Apache Software License

Requires

Python >=3.7

Provides Extra

testing docs dev

Tags

NLP tokenizer BPE transformer deep learning

Classifiers

Report project as malware

Release files for tokenizers 0.20.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tokenizers 0.20.3
File Size Uploaded
tokenizers-0.20.3.tar.gz 340.5 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for tokenizers 0.20.3
File
tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.10 PyPy 3.10 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.10 PyPy 3.10 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.10 PyPy 3.10 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.10 PyPy 3.10 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.10 PyPy 3.10 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.9 PyPy 3.9 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.9 PyPy 3.9 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.9 PyPy 3.9 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.9 PyPy 3.9 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.9 PyPy 3.9 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.8 PyPy 3.8 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.8 PyPy 3.8 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.8 PyPy 3.8 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whl 2.6 MB PyPy 3.8 PyPy 3.8 7.3 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.8 PyPy 3.8 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl 9.3 MB PyPy 3.7 PyPy 3.7 7.3 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl 9.0 MB PyPy 3.7 PyPy 3.7 7.3 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB PyPy 3.7 PyPy 3.7 7.3 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whl 2.7 MB PyPy 3.7 PyPy 3.7 7.3 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp313-none-win_amd64.whl 2.4 MB CPython 3.13 none Windows x86-64 Details
tokenizers-0.20.3-cp313-none-win32.whl 2.2 MB CPython 3.13 none Windows x86-32 Details
tokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.13 CPython 3.13 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.13 CPython 3.13 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.13 CPython 3.13 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whl 2.6 MB CPython 3.13 CPython 3.13 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whl 2.7 MB CPython 3.13 CPython 3.13 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp312-none-win_amd64.whl 2.4 MB CPython 3.12 none Windows x86-64 Details
tokenizers-0.20.3-cp312-none-win32.whl 2.2 MB CPython 3.12 none Windows x86-32 Details
tokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.12 CPython 3.12 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.12 CPython 3.12 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.12 CPython 3.12 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whl 2.6 MB CPython 3.12 CPython 3.12 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whl 2.7 MB CPython 3.12 CPython 3.12 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp311-none-win_amd64.whl 2.4 MB CPython 3.11 none Windows x86-64 Details
tokenizers-0.20.3-cp311-none-win32.whl 2.2 MB CPython 3.11 none Windows x86-32 Details
tokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.11 CPython 3.11 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.11 CPython 3.11 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.11 CPython 3.11 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whl 2.6 MB CPython 3.11 CPython 3.11 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whl 2.7 MB CPython 3.11 CPython 3.11 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp310-none-win_amd64.whl 2.4 MB CPython 3.10 none Windows x86-64 Details
tokenizers-0.20.3-cp310-none-win32.whl 2.2 MB CPython 3.10 none Windows x86-32 Details
tokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.10 CPython 3.10 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.10 CPython 3.10 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.10 CPython 3.10 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whl 2.6 MB CPython 3.10 CPython 3.10 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whl 2.7 MB CPython 3.10 CPython 3.10 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp39-none-win_amd64.whl 2.4 MB CPython 3.9 none Windows x86-64 Details
tokenizers-0.20.3-cp39-none-win32.whl 2.2 MB CPython 3.9 none Windows x86-32 Details
tokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.9 CPython 3.9 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.9 CPython 3.9 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.9 CPython 3.9 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whl 2.6 MB CPython 3.9 CPython 3.9 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whl 2.7 MB CPython 3.9 CPython 3.9 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp38-none-win_amd64.whl 2.4 MB CPython 3.8 none Windows x86-64 Details
tokenizers-0.20.3-cp38-none-win32.whl 2.2 MB CPython 3.8 none Windows x86-32 Details
tokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.8 CPython 3.8 Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.8 CPython 3.8 Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.8 CPython 3.8 Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whl 2.6 MB CPython 3.8 CPython 3.8 macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whl 2.7 MB CPython 3.8 CPython 3.8 macOS 10.12+ x86-64 Details
tokenizers-0.20.3-cp37-none-win_amd64.whl 2.4 MB CPython 3.7 none Windows x86-64 Details
tokenizers-0.20.3-cp37-none-win32.whl 2.2 MB CPython 3.7 none Windows x86-32 Details
tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whl 9.3 MB CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ x86-64 Details
tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whl 9.0 MB CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ ARM64 Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 3.0 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64 Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl 3.4 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ IBM System/390x Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl 3.1 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ PowerPC 64-le Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl 3.1 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-32 Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl 2.8 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARMv7l Details
tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 2.9 MB CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARM64 Details
tokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whl 2.6 MB CPython 3.7 CPython 3.7 pymalloc macOS 11.0+ ARM64 Details
tokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whl 2.7 MB CPython 3.7 CPython 3.7 pymalloc macOS 10.12+ x86-64 Details

Total release size: 452.3 MB

Release files / tokenizers-0.20.3.tar.gz

Download URL tokenizers-0.20.3.tar.gz
Size 340.5 kB
Tags Source
SHA-256 checksum
How to use checksums 		2278b34c5d0dd78e087e1ca7f9b1dcbf129d80211afa645f214bd6e051037539
BLAKE2b-256 checksum
How to use checksums 		da25b1681c1c30ea3ea6e584ae3fffd552430b12faa599b558c4c4783f56d7ff
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		efcf0eb939988b627558aaf2b9dc3e56d759cad2e0cfa04fcab378e4b48fc4fd
BLAKE2b-256 checksum
How to use checksums 		e8bd48475818e614b73316baf37ac1e4e51b578bbdf58651812d7e55f43b88d8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		55046ad3dd5f2b3c67501fcc8c9cbe3e901d8355f08a3b745e9b57894855f85b
BLAKE2b-256 checksum
How to use checksums 		68604107b618b7b9155cb34ad2e0fc90946b7e71f041b642122fb6314f660688
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		a07962340b36189b6c8feda552ea1bfeee6cf067ff922a1d7760662c2ee229e5
BLAKE2b-256 checksum
How to use checksums 		0a6056510124933136c2e90879e1c81603cfa753ae5a87830e3ef95056b20d8f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		e005466632b1c5d2d2120f6de8aa768cc9d36cd1ab7d51d0c27a114c91a1e6ee
BLAKE2b-256 checksum
How to use checksums 		9a0bc076b2ff3ee6dc70c805181fbe325668b89cfee856f8dfa24cc9aa293c84
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.10 PyPy 3.10 7.3
SHA-256 checksum
How to use checksums 		39270a7050deaf50f7caff4c532c01b3c48f6608d42b3eacdebdc6795478c8df
BLAKE2b-256 checksum
How to use checksums 		8ec16af62ef61316f33ecf785bbb2bee4292f34ea62b491d4480ad9b09acf6b6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.10 PyPy 3.10 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		b8e9608f2773996cc272156e305bd79066163a66b0390fe21750aff62df1ac07
BLAKE2b-256 checksum
How to use checksums 		b59e7a2c00abbc8edb021ee0b1f12aab76a7b7824b49f94bcd9f075d0818d4b0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.10 PyPy 3.10 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		e919f2e3e68bb51dc31de4fcbbeff3bdf9c1cad489044c75e2b982a91059bd3c
BLAKE2b-256 checksum
How to use checksums 		29cdff1586dd572aaf1637d59968df3f6f6532fa255f4638fbc29f6d27e0b690
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		c4fd4d71e6deb6ddf99d8d0eab87d1d16f635898906e631914a9bae8ae9f2cfb
BLAKE2b-256 checksum
How to use checksums 		2ba7e0b5d5fea8cb69afdbab3c0e0cc3a02b5dd888ce0f933312f7c0ca6b017e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		5a8d8261ca2133d4f98aa9627c748189502b3787537ba3d7e2beb4f7cfc5d627
BLAKE2b-256 checksum
How to use checksums 		6b7f3a1d5ded5f841764d67aa4c6e2e4b40d9dac5fbd2df135bccc58284a6917
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		900991a2b8ee35961b1095db7e265342e0e42a84c1a594823d5ee9f8fb791958
BLAKE2b-256 checksum
How to use checksums 		e0b8479ab7349faf1da001b861ea521055ad18a34a9b1053079e0c9b5c476f50
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		8dcd91f4e60f62b20d83a87a84fe062035a1e3ff49a8c2bbdeb2d441c8e311f4
BLAKE2b-256 checksum
How to use checksums 		79e4fdd7ad2aedaa4a3f148aa28670bf0b0856211a3fec3e6554ed6ceec9a928
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.9 PyPy 3.9 7.3
SHA-256 checksum
How to use checksums 		a292392f24ab9abac5cfa8197e5a6208f2e43723420217e1ceba0b4ec77816ac
BLAKE2b-256 checksum
How to use checksums 		ce3237ff2ced2c169c2e7586fcd51314f59d02c60fd2eeafea527c2f9d1bb512
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.9 PyPy 3.9 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		c3db46cc0647bfd88263afdb739b92017a02a87ee30945cb3e86c7e25c7c9917
BLAKE2b-256 checksum
How to use checksums 		eb6d2d9f5a93f88470f8dae7b2069734ba0a5d30659761ce5a6067913e7d4333
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.9 PyPy 3.9 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		de082392a85eb0055cc055c535bff2f0cc15d7a000bdc36fbf601a0f3cf8507a
BLAKE2b-256 checksum
How to use checksums 		55baf0b0c5dd6a2eb4ac83fd890f1f6e402a8f245faeeca37b52b794fe738ed9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		3eda46ca402751ec82553a321bf35a617b76bbed7586e768c02ccacbdda94d6d
BLAKE2b-256 checksum
How to use checksums 		0b768ceb248a4d9ca8f20269732a7877f014bcb8a39ba2756a39eea7a2e07dae
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		6ee4954c1dd23aadc27958dad759006e71659d497dcb0ef0c7c87ea992c16ebd
BLAKE2b-256 checksum
How to use checksums 		6a8be3f2808c24785fb999a046700132c1888733cc0fe416331061507a938758
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		da1ec842035ed9999c62e45fbe0ff14b7e8a7e02bb97688cc6313cf65e5cd755
BLAKE2b-256 checksum
How to use checksums 		a7b1514869f7f24a4cd2da8cf8f697f322953858799813beb90830068e4d3667
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		4e615de179bbe060ab33773f0d98a8a8572b5883dd7dac66c1de8c056c7e748c
BLAKE2b-256 checksum
How to use checksums 		e32cb9822ac2b2032e7b30ca0a25cac5ea388ee28fde065ab8f42d0fa1283172
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.8 PyPy 3.8 7.3
SHA-256 checksum
How to use checksums 		b48971b88ef9130bf35b41b35fd857c3c4dae4a9cd7990ebc7fc03e59cc92438
BLAKE2b-256 checksum
How to use checksums 		daba8e94438ae07a27fe2fc54ee20be5bf2f1d4937cda474b02e1902b7fe94de
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whl
Size 2.6 MB
Tags PyPy 3.8 PyPy 3.8 7.3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		c697cbd3be7a79ea250ea5f380d6f12e534c543cfb137d5c734966b3ee4f34cc
BLAKE2b-256 checksum
How to use checksums 		4f982228537b9d26a41a36eb0dff17b57a6fc6223facb06f5e02f141f2ae8b14
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.8 PyPy 3.8 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		c31751f0721f58f5e19bb27c1acc259aeff860d8629c4e1a900b26a1979ada8e
BLAKE2b-256 checksum
How to use checksums 		dd4c2ca1ef18eebf1021b98d44db96b26bca782650a3011aff1c87c181852630
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags Linux musl 1.1+ x86-64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		c47c037116310dc976eb96b008e41b9cfaba002ed8005848d4d632ee0b7ba9ae
BLAKE2b-256 checksum
How to use checksums 		bdb94358ae4869d3642a5d7f032fe1123c57b132f5721f1097426611996721ea
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags Linux musl 1.1+ ARM64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		fbaf3ea28fedfb2283da60e710aff25492e795a7397cad8a50f1e079b65a5a70
BLAKE2b-256 checksum
How to use checksums 		1ece4309d896c2067f2253335dab1bb69f917f438d87b3770b93e9c635dddbf6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags Linux glibc 2.17+ x86-64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		b1e5bfaae740ef9ece000f8a07e78ac0e2b085c5ce9648f8593ddf0243c9f76d
BLAKE2b-256 checksum
How to use checksums 		02f3dea642bfc6b04354307b0a7759517da508bc4cf2ec631ed9c5de3452f4a2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags Linux glibc 2.17+ x86-32 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		57a2a56397b2bec5a629b516b23f0f8a3e4f978c7488d4a299980f8375954b85
BLAKE2b-256 checksum
How to use checksums 		d08a62d09ed4ffc34c7db5a3022d5ea92a21c27dae3cf21ee69a68ca48716169
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags Linux glibc 2.17+ ARM64 PyPy 3.7 PyPy 3.7 7.3
SHA-256 checksum
How to use checksums 		4d53029fe44bc70c3ff14ef512460a0cf583495a0f8e2f4b70e26eb9438e38a9
BLAKE2b-256 checksum
How to use checksums 		bcdec94057443d8661f80af0712e0424449fa67861029b4184ec0615ce9d75af
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags PyPy 3.7 PyPy 3.7 7.3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		f3558a7ae6a6d38a77dfce12172a1e2e1bf3e8871e744a1861cd7591ea9ebe24
BLAKE2b-256 checksum
How to use checksums 		4c38e30e70c7e9ad15fb2a86cbec5356d986d0354c7fa0016c3b0820d861b85c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp313-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums 		d50ede425c7e60966a9680d41b58b3a0950afa1bb570488e2972fa61662c4273
BLAKE2b-256 checksum
How to use checksums 		c2ffac8410f868fb8b14b5e619efa304aa119cb8a40bd7df29fc81a898e64f99
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-none-win32.whl

Download URL tokenizers-0.20.3-cp313-none-win32.whl
Size 2.2 MB
Tags CPython 3.13 Windows x86-32
SHA-256 checksum
How to use checksums 		6e19e0f1d854d6ab7ea0c743d06e764d1d9a546932be0a67f33087645f00fe13
BLAKE2b-256 checksum
How to use checksums 		661179d91aeb2817ad1993ef61c690afe73e6dbedbfb21918b302ef5a2ba9bfb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.13 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		a4c186bb006ccbe1f5cc4e0380d1ce7806f5955c244074fd96abc55e27b77f01
BLAKE2b-256 checksum
How to use checksums 		d63f49fa63422159bbc2f2a4ac5bfc597d04d4ec0ad3d2ef46649b5e9a340e37
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.13 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		bd44e48a430ada902c6266a8245f5036c4fe744fcb51f699999fbe82aa438797
BLAKE2b-256 checksum
How to use checksums 		7c64f1993bb8ebf775d56875ca0d50a50f2648bfbbb143da92fe2e6ceeb4abd5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.13 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		07d7851a72717321022f3774e84aa9d595a041d643fafa2e87fbc9b18711dac0
BLAKE2b-256 checksum
How to use checksums 		66527a171bd4929e3ffe61a29b4340fe5b73484709f92a8162a18946e124c34c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.13 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		2b26b0aadb18cd8701077362ba359a06683662d5cafe3e8e8aba10eb05c037f1
BLAKE2b-256 checksum
How to use checksums 		d514f0df0ee3b9e516121e23c0099bccd7b9f086ba9150021a750e99b16ce56f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.13 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		78c8c143e3ae41e718588281eb3e212c2b31623c9d6d40410ec464d7d6221fb5
BLAKE2b-256 checksum
How to use checksums 		c62297e1e95ee81f75922c9f569c23cb2b1fdc7f5a7a29c4c9fae17e63f751a6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.13 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		098b8a632b8656aa5802c46689462c5c48f02510f24029d71c208ec2c822e771
BLAKE2b-256 checksum
How to use checksums 		0ba7bc421fe46650cc4eb4a913a236b88c243204f32c7480684d2f138925899e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.13 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		174a54910bed1b089226512b4458ea60d6d6fd93060254734d3bc3540953c51c
BLAKE2b-256 checksum
How to use checksums 		2ce5af3078e32f225e680e69d61f78855880edb8d53f5850a1834d519b2b103f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.13 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		0e3d80d89b068bc30034034b5319218c7c0a91b00af19679833f55f3becb6945
BLAKE2b-256 checksum
How to use checksums 		7ccf5309c2d173a6a67f9ec8697d8e710ea32418de6fd8541778032c202a1c3e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		a02d160d2b19bcbfdf28bd9a4bf11be4cb97d0499c000d95d4c4b1a4312740b6
BLAKE2b-256 checksum
How to use checksums 		b9c7e2ce1d4f756c8a62ef93fdb4df877c2185339b6d63667b015bf70ea9d34b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.13 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		e0b630e0b536ef0e3c8b42c685c1bc93bd19e98c0f1543db52911f8ede42cf84
BLAKE2b-256 checksum
How to use checksums 		071936e9eaafb229616cb8502b42030fa7fe347550e76cb618de71b498fc3222
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp312-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums 		44def74cee574d609a36e17c8914311d1b5dbcfe37c55fd29369d42591b91cf2
BLAKE2b-256 checksum
How to use checksums 		bd6861d85ae7ae96dde7d0974ff3538db75d5cdc29be2e4329cd7fc51a283e22
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-none-win32.whl

Download URL tokenizers-0.20.3-cp312-none-win32.whl
Size 2.2 MB
Tags CPython 3.12 Windows x86-32
SHA-256 checksum
How to use checksums 		83d9bfbe9af86f2d9df4833c22e94d94750f1d0cd9bfb22a7bb90a86f61cdb1c
BLAKE2b-256 checksum
How to use checksums 		bea996172310ee141009646d63a1ca267c099c462d747fe5ef7e33f74e27a683
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.12 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		2b6e54e71f84c4202111a489879005cb14b92616a87417f6c102c833af961ea2
BLAKE2b-256 checksum
How to use checksums 		90af60c957af8d2244321124e893828f1a4817cde1a2d08d09d423b73f19bd2f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.12 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		124c5882ebb88dadae1fc788a582299fcd3a8bd84fc3e260b9918cf28b8751f5
BLAKE2b-256 checksum
How to use checksums 		55e9a80d4e592307688a67c7c59ab77e03687b6a8bd92eb5db763a2c80f93f57
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.12 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		f2b7cb962564785a83dafbba0144ecb7f579f1d57d8c406cdaa7f32fe32f18ad
BLAKE2b-256 checksum
How to use checksums 		9e65c83cb3545a65a9eaa2e13b22c93d5e00bd7624b354a44adbdc93d5d9bd91
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.12 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		312d522caeb8a1a42ebdec87118d99b22667782b67898a76c963c058a7e41d4f
BLAKE2b-256 checksum
How to use checksums 		1ff4a8a33f0192a1629a3bd0afcad17d4d221bbf9276da4b95d226364208d5eb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.12 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		16384073973f6ccbde9852157a4fdfe632bb65208139c9d0c0bd0176a71fd67f
BLAKE2b-256 checksum
How to use checksums 		b43ba2a7962c496ebcd95860ca99e423254f760f382cd4bd376f8895783afaf5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.12 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		ef279c7e239f95c8bdd6ff319d9870f30f0d24915b04895f55b1adcf96d6c60d
BLAKE2b-256 checksum
How to use checksums 		294e8a9a3c89e128c4a40f247b501c10279d2d7ade685953407c4d94c8c0f7a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.12 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		ca94fc1b73b3883c98f0c88c77700b13d55b49f1071dfd57df2b06f3ff7afd64
BLAKE2b-256 checksum
How to use checksums 		b22732f29da16d28f59472fa7fb38e7782069748c7e9ab9854522db20341624c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.12 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		abe4e08c7d0cd6154c795deb5bf81d2122f36daf075e0c12a8b050d824ef0a64
BLAKE2b-256 checksum
How to use checksums 		2737d108df55daf4f0fcf1f58554692ff71687c273d870a34693066f0847be96
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		282848cacfb9c06d5e51489f38ec5aa0b3cd1e247a023061945f71f41d949d73
BLAKE2b-256 checksum
How to use checksums 		ec9ae17a352f0bffbf415cf7d73756f5c73a3219225fc5957bc2f39d52c61684
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.12 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		49d12a32e190fad0e79e5bdb788d05da2f20d8e006b13a70859ac47fecf6ab2f
BLAKE2b-256 checksum
How to use checksums 		070092a08af2a6b0c88c50f1ab47d7189e695722ad9714b0ee78ea5e1e2e1def
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp311-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums 		88301aa0801f225725b6df5dea3d77c80365ff2362ca7e252583f2b4809c4cc0
BLAKE2b-256 checksum
How to use checksums 		75681b4f928b15a36ed278332ac75d66d7eb65d865bf344d049c452c18447bf9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-none-win32.whl

Download URL tokenizers-0.20.3-cp311-none-win32.whl
Size 2.2 MB
Tags CPython 3.11 Windows x86-32
SHA-256 checksum
How to use checksums 		efcce3a927b1e20ca694ba13f7a68c59b0bd859ef71e441db68ee42cf20c2442
BLAKE2b-256 checksum
How to use checksums 		5047722feb70ee68d1c4412b12d0ea4acc2713179fd63f054913990f9e259492
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.11 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		843729bf0f991b29655a069a2ff58a4c24375a553c70955e15e37a90dd4e045c
BLAKE2b-256 checksum
How to use checksums 		e9ac1c069e7808181ff57bcf2d39e9b6fbee9133a55410e6ebdaa89f67c32e83
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.11 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		4bb31f7b2847e439766aaa9cc7bccf7ac7088052deccdb2275c952d96f691c6a
BLAKE2b-256 checksum
How to use checksums 		a3b200915c4fed08e9505d37cf6eaab45b12b4bff8f6719d459abcb9ead86a4b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.11 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		453c7769d22231960ee0e883d1005c93c68015025a5e4ae56275406d94a3c907
BLAKE2b-256 checksum
How to use checksums 		50f62841de926bc4118af996eaf0bdf0ea5b012245044766ffc0347e6c968e63
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.11 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		37c04c032c1442740b2c2d925f1857885c07619224a533123ac7ea71ca5713da
BLAKE2b-256 checksum
How to use checksums 		58ce9793f2dc2ce529369807c9c74e42722b05034af411d60f5730b720388c7d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.11 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		444d188186eab3148baf0615b522461b41b1f0cd58cd57b862ec94b6ac9780f1
BLAKE2b-256 checksum
How to use checksums 		6bac4637ba619db25094998523f9e6f5b456e1db1f8faa770a3d925d436db0c3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.11 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		ff1ef8bd47a02b0dc191688ccb4da53600df5d4c9a05a4b68e1e3de4823e78eb
BLAKE2b-256 checksum
How to use checksums 		1a7462ad983e8ea6a63e04ed9c5be0b605056bf8aac2f0125f9b5e0b3e2b89fa
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.11 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		67ef4dcb8841a4988cd00dd288fb95dfc8e22ed021f01f37348fd51c2b055ba9
BLAKE2b-256 checksum
How to use checksums 		e6b0cc369fb3297d61f3311cab523d16d48c869dc2f0ba32985dbf03ff811041
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.11 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		ef820880d5e4e8484e2fa54ff8d297bb32519eaa7815694dc835ace9130a3eea
BLAKE2b-256 checksum
How to use checksums 		4654033b5b2ba0c3ae01e026c6f7ced147d41a2fa1c573d00a66cb97f6d7f9b3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		61cbf11954f3b481d08723ebd048ba4b11e582986f9be74d2c3bdd9293a4538d
BLAKE2b-256 checksum
How to use checksums 		aa14e75ece72e99f6ef9ae07777ca9fdd78608f69466a5cecf636e9bd2f25d5c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.11 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		585b51e06ca1f4839ce7759941e66766d7b060dccfdc57c4ca1e5b9a33013a90
BLAKE2b-256 checksum
How to use checksums 		c6936742ef9206409d5ce1fdf44d5ca1687cdc3847ba0485424e2c731e6bcf67
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp310-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.10 Windows x86-64
SHA-256 checksum
How to use checksums 		a845c08fdad554fe0871d1255df85772f91236e5fd6b9287ef8b64f5807dbd0c
BLAKE2b-256 checksum
How to use checksums 		4762aaf5b2a526b3b10c20985d9568ff8c8f27159345eaef3347831e78cd5894
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-none-win32.whl

Download URL tokenizers-0.20.3-cp310-none-win32.whl
Size 2.2 MB
Tags CPython 3.10 Windows x86-32
SHA-256 checksum
How to use checksums 		ee31ba9d7df6a98619426283e80c6359f167e2e9882d9ce1b0254937dbd32f3f
BLAKE2b-256 checksum
How to use checksums 		717d5e3307a1091c8608a1e58043dff49521bc19553c6e9548c7fac6840cc2c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.10 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		ba96367db9d8a730d3a1d5996b4b7babb846c3994b8ef14008cd8660f55db59d
BLAKE2b-256 checksum
How to use checksums 		be7e6126c18694310fe07970717929e889898767c41fbdd95b9078e8aec0f9ef
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.10 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		9e7816808b402129393a435ea2a509679b41246175d6e5e9f25b8692bfaa272b
BLAKE2b-256 checksum
How to use checksums 		f464693afc9ba2393c2eed85c02bacb44762f06a29f0d1a5591fa5b40b39c0a2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		1fd9fee817f655a8f50049f685e224828abfadd436b8ff67979fc1d054b435f1
BLAKE2b-256 checksum
How to use checksums 		aa4915fae66ac62e49255eeedbb7f4127564b2c3f3aef2009913f525732d1a08
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.10 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		a333d878c4970b72d6c07848b90c05f6b045cf9273fc2bc04a27211721ad6118
BLAKE2b-256 checksum
How to use checksums 		f3467a025404201d937f86548928616c0a164308aa3998e546efdf798bf5ee9c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.10 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		b357970c095dc134978a68c67d845a1e3803ab7c4fbb39195bde914e7e13cf8b
BLAKE2b-256 checksum
How to use checksums 		2e8382ba40da99870b3a0b801cffaf4f099f088a84c7e07d32cc6ca751ce08e6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		b7850fde24197fe5cd6556e2fdba53a6d3bae67c531ea33a3d7c420b90904141
BLAKE2b-256 checksum
How to use checksums 		26441f8aea48f9bb117d966b7272484671b33a509f6217a8e8544d79442c90db
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.10 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		79c4121a2e9433ad7ef0769b9ca1f7dd7fa4c0cd501763d0a030afcbc6384481
BLAKE2b-256 checksum
How to use checksums 		b07215fdbc149e05005e99431ecd471807db2241983deafe1e704020f608f40e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		f128d5da1202b78fa0a10d8d938610472487da01b57098d48f7e944384362514
BLAKE2b-256 checksum
How to use checksums 		e3e80e9f81a09ab79f409eabfd99391ca519e315496694671bebca24c3e90448
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		c6361191f762bda98c773da418cf511cbaa0cb8d0a1196f16f8c0119bde68ff8
BLAKE2b-256 checksum
How to use checksums 		a6e9f651f8d27614fd59af387f4dfa568b55207e5fac8d06eec106dc00b921c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.10 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		31ccab28dbb1a9fe539787210b0026e22debeab1662970f61c2d921f7557f7e4
BLAKE2b-256 checksum
How to use checksums 		c851421bb0052fc4333f7c1e3231d8c6607552933d919b628c8fabd06f60ba1e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp39-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.9 Windows x86-64
SHA-256 checksum
How to use checksums 		7498f3ea7746133335a6adb67a77cf77227a8b82c8483f644a2e5f86fea42b8d
BLAKE2b-256 checksum
How to use checksums 		0de3ad08926d9a9dd238ec67d429db13f34db31bc4ecd726207fa95b90779462
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-none-win32.whl

Download URL tokenizers-0.20.3-cp39-none-win32.whl
Size 2.2 MB
Tags CPython 3.9 Windows x86-32
SHA-256 checksum
How to use checksums 		401cc21ef642ee235985d747f65e18f639464d377c70836c9003df208d582064
BLAKE2b-256 checksum
How to use checksums 		7ded06e4c10020f3c26faf62dcbe786d8dfad60ca119bb1f3e5f32dccd0ce9b4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.9 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		16121eb030a2b13094cfec936b0c12e8b4063c5f839591ea7d0212336d8f9921
BLAKE2b-256 checksum
How to use checksums 		ef2d8b823741c64e9726b82076fa09f6d66285b61bd2c77e109871415b1ed9e2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.9 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		7310ab23d7b0caebecc0e8be11a1146f320f5f07284000f6ea54793e83de1b75
BLAKE2b-256 checksum
How to use checksums 		95ff01fdcf9a77776730baf63a9f66adf75c3aa4bdb1bdc77c7d1a3e03b2a25e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.9 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		938441babf3e5720e4459e306ef2809fb267680df9d1ff2873458b22aef60248
BLAKE2b-256 checksum
How to use checksums 		299ec95f8821d6bc93eba7c5db95e6299c009db523d1c646da8563b42ad892c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.9 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		bee8f53b2594749f4460d53253bae55d718f04e9b633efa0f5df8938bd98e4f0
BLAKE2b-256 checksum
How to use checksums 		0c6aa94248dc5915907e18d55c9739cd018f5aeb4146f198622f45f9748dcb9f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.9 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		a1d469c74eebf5c43fd61cd9b030e271d17198edd7bd45392e03a3c091d7d6d4
BLAKE2b-256 checksum
How to use checksums 		01e1d96e90ef872dd9b3a4b7a78874411f1c48476019f95a87a2cfd54c470a57
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.9 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		6f90549622de3bf476ad9f1dd6f3f952ec3ed6ab8615ae88ef060d0c5bfad55d
BLAKE2b-256 checksum
How to use checksums 		3ed56b2b519ba2d9a6d3435f22918f0ad5850c40cf5357f6d989e6d68ef40fb9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.9 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		bfa8d029bb156181b006643309d6b673615a24e4ed24cf03aa191d599b996f51
BLAKE2b-256 checksum
How to use checksums 		c1d9b9ff819c3df4bc73ad93629804f7b85321a78bc2da4f54fb774a90e995c6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.9 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		7eb2fb1c432f5746b22f8a7f09fc18c4156cb0031c77f53cb19379d82d43297a
BLAKE2b-256 checksum
How to use checksums 		b039073836c1d73e63268b1c67a682a8ba23e2688a43e737166be45ab8243701
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		f4cb0c614b0135e781de96c2af87e73da0389ac1458e2a97562ed26e29490d8d
BLAKE2b-256 checksum
How to use checksums 		e78a29388a69722188352f5f9006a392d692e4739688779475713e552ef3a1b3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.9 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		93e37f0269a11dc3b1a953f1fca9707f0929ebf8b4063c591c71a0664219988e
BLAKE2b-256 checksum
How to use checksums 		42a8ccc7be89a644aeba926a7c8779d659e856f4af4ee8fbdfb71a07f6a98a84
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp38-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.8 Windows x86-64
SHA-256 checksum
How to use checksums 		205a45246ed7f1718cf3785cff88450ba603352412aaf220ace026384aa3f1c0
BLAKE2b-256 checksum
How to use checksums 		6740bd86347e7178a489476a922f004b396335d4f7ceab40ef01dbbf47dbae64
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-none-win32.whl

Download URL tokenizers-0.20.3-cp38-none-win32.whl
Size 2.2 MB
Tags CPython 3.8 Windows x86-32
SHA-256 checksum
How to use checksums 		84d40ee0f8550d64d3ea92dd7d24a8557a9172165bdb986c9fb2503b4fe4e3b6
BLAKE2b-256 checksum
How to use checksums 		02175f67f15ededc42049a741e55a20005b5122f7f3272e8d761d3f34b76910c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.8 Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		0fc7a39e5bedc817bda395a798dfe2d9c5f7c71153c90d381b5135a0328d9520
BLAKE2b-256 checksum
How to use checksums 		5935d641f0b8d8b3d26e536f71e2ebc65628294d10863e92966da0b3983f32b9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.8 Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		62d00ba208358c037eeab7bfc00a905adc67b2d31b68ab40ed09d75881e114ea
BLAKE2b-256 checksum
How to use checksums 		36ae47d941df047349cf56d2f9f2487dcd04c6780a360801f4044d275376d386
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		7b6583a65c01db1197c1eb36857ceba8ec329d53afadd268b42a6b04f4965724
BLAKE2b-256 checksum
How to use checksums 		0252cd7b83b6e0a1fda503ca7184b0162583de6d2f176dda9aa02abf80cb247b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.8 Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		f2475bb004ab2009d29aff13b5047bfdb3d4b474f0aa9d4faa13a7f34dbbbb43
BLAKE2b-256 checksum
How to use checksums 		4687f01ce46c2d2c72364f0ade606134366355fd3a482e8c8e827f0816ec0b97
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.8 Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		98d343134f47159e81f7f242264b0eb222e6b802f37173c8d7d7b64d5c9d1388
BLAKE2b-256 checksum
How to use checksums 		305202c71ffe032ef45a2680d7875629cefaea97286dd69ab4e8758b6376065d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		65ab780194da4e1fcf5670523a2f377c4838ebf5249efe41fa1eddd2a84fb49d
BLAKE2b-256 checksum
How to use checksums 		49a4ecc1e4f664f33fa17764daee6c8c8556d6337f5076ffb97a4def715bc7a9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.8 Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		c27ceb887f0e81a3c377eb4605dca7a95a81262761c0fba308d627b2abb98f2b
BLAKE2b-256 checksum
How to use checksums 		a50d0cd849094800a5057988ab710ed9cb843aeedf7d0ac9d6a7bde653d250de
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.8 Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		04627b7b502fa6a2a005e1bd446fa4247d89abcb1afaa1b81eb90e21aba9a60f
BLAKE2b-256 checksum
How to use checksums 		4a5fd8edae0841c5bcaed387ce11359e4ee20d09fc9831b7487a8a946c65f97a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.8 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		6ac52cc24bad3de865c7e65b1c4e7b70d00938a8ae09a92a453b8f676e714ad5
BLAKE2b-256 checksum
How to use checksums 		2083a620059226e5c864c02d133510927cf64d649887469025de6caef15acd42
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.8 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		3229ef103c89583d10b9378afa5d601b91e6337530a0988e17ca8d635329a996
BLAKE2b-256 checksum
How to use checksums 		d4a077f395c23daf492b6cfcbd8d33213b1ec305d79af13942d6ef7a895b7c3a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-none-win_amd64.whl

Download URL tokenizers-0.20.3-cp37-none-win_amd64.whl
Size 2.4 MB
Tags CPython 3.7 Windows x86-64
SHA-256 checksum
How to use checksums 		60ac483cebee1c12c71878523e768df02fa17e4c54412966cb3ac862c91b36c1
BLAKE2b-256 checksum
How to use checksums 		c7b9d8bdef419f4643b5e6a0b9b8442877e39a27658d5634df443e12d767caec
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-none-win32.whl

Download URL tokenizers-0.20.3-cp37-none-win32.whl
Size 2.2 MB
Tags CPython 3.7 Windows x86-32
SHA-256 checksum
How to use checksums 		ab48184cd58b4a03022a2ec75b54c9f600ffea9a733612c02325ed636f353729
BLAKE2b-256 checksum
How to use checksums 		5d534f619ee8f4249b07007c5d74a2637e4571c7013a3b549b3d02b3b2157769
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whl
Size 9.3 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ x86-64
SHA-256 checksum
How to use checksums 		0e9b81321a1e05b16487d312b4264984513f8b4a7556229cafac6e88c2036b09
BLAKE2b-256 checksum
How to use checksums 		1f008bdf0b2728803b69a7b8c4e29b0376cdd60632c4874c7437a9894bdf4e42
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whl
Size 9.0 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux musl 1.1+ ARM64
SHA-256 checksum
How to use checksums 		1f74909ef7675c26d4095a817ec3393d67f3158ca4836c233212e5613ef640c4
BLAKE2b-256 checksum
How to use checksums 		8531326a2e7971e5e13c18a336501684dd22c9ad3e1d11ce6daad47b17524f2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 3.0 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums 		18e4c7c64172e7789bd8b07aa3087ea87c4c4de7e90937a2aa036b5d92332536
BLAKE2b-256 checksum
How to use checksums 		651cda88fef2898d4f243b7bb59de3e7be9fca7f022d0fc147342df36a0f6721
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whl
Size 3.4 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ IBM System/390x
SHA-256 checksum
How to use checksums 		b4ba635165bc1ea46f2da8e5d80b5f70f6ec42161e38d96dbef33bb39df73964
BLAKE2b-256 checksum
How to use checksums 		328780b0b090457e38cfcfb9ac24fd604b1c9640c7f27e483e064428a26d1496
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 3.1 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums 		d5634b2e2f5f3d2b4439d2d74066e22eb4b1f04f3fea05cb2a3c12d89b5a3bcd
BLAKE2b-256 checksum
How to use checksums 		2f2944d7d5e01bc6d0ca643e777b6995b983a8a5e8c17301524d5a369324bbd2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whl
Size 3.1 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums 		a8cc0e8176b762973758a77f0d9c4467d310e33165fb74173418ca3734944da4
BLAKE2b-256 checksum
How to use checksums 		8cc0bcb254910ae587d6e97c26b1ab6aac3fabd2ca51f697bdc7c7ba45cbbf44
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
Size 2.8 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARMv7l
SHA-256 checksum
How to use checksums 		1b80e3c7283a01a356bd2210f53d1a4a5d32b269c2024389ed0173137708d50e
BLAKE2b-256 checksum
How to use checksums 		56f6a75cbc9c8aa11c836a3bddb2107ad24294830acc28f74d943c9eda7df6ae
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 2.9 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ ARM64
SHA-256 checksum
How to use checksums 		c4a7fd678b35614fca708579eb95b7587a5e8a6d328171bd2488fd9f27d82be4
BLAKE2b-256 checksum
How to use checksums 		b413f0118eb623764a71dd45b40f4fb2148380f66979c542a2aa4fa982e20456
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whl
Size 2.6 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		6dde2cae6004ba7a3badff4a11911cae03ebf23e97eebfc0e71fef2530e5074f
BLAKE2b-256 checksum
How to use checksums 		6bacd335dcd8b23758244e34c2f63cd8b7ac9db0997fe5989a4729111c937c06
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release files / tokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whl

Download URL tokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whl
Size 2.7 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums 		9adda1ff5fb9dcdf899ceca672a4e2ce9e797adb512a6467305ca3d8bfcfbdd0
BLAKE2b-256 checksum
How to use checksums 		f9597598a52c3f4897d00c52ff43f1a90ec09211dd163afab272cda368d856f9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		No
Uploaded via twine/5.1.1 CPython/3.13.0

Release history Release notifications | RSS feed

Pre-release

1.0.0rc2

24 release files

Pre-release

1.0.0rc1

24 release files

0.23.2

17 release files

0.23.1

17 release files

Pre-release

0.23.1rc0

17 release files

Pre-release

0.23.0rc0

17 release files

0.22.2

24 release files

Pre-release

0.22.2rc0

22 release files

0.22.1

15 release files

Pre-release

0.22.1rc0

15 release files

0.22.0

15 release files

Pre-release

0.22.0rc0

4 release files

0.21.4

15 release files

0.21.2

15 release files

Pre-release

0.21.2rc0

15 release files

0.21.1

15 release files

Pre-release

0.21.1rc0

15 release files

0.21.0

15 release files

Pre-release

0.21.0rc0

15 release files

Yanked

0.20.4

15 release files

Yanked reason: Removing support for python3.7 and 3.8 is breaking and is move to v0.21.0

Pre-release

0.20.4rc0

15 release files

This release

0.20.3 This release

112 release files

0.20.2

112 release files

0.20.1

100 release files

0.20.0

100 release files

0.19.1

100 release files

0.19.0

100 release files

0.15.2

110 release files

0.15.1

110 release files

0.15.0

98 release files

0.14.1

98 release files

0.14.0

98 release files

0.13.3

40 release files

0.13.2

40 release files

0.13.1

31 release files

0.13.0

31 release files

0.12.1

33 release files

Yanked

0.12.0

33 release files

Yanked reason: Breaking change with unexpected effect

0.11.6

38 release files

0.11.5

33 release files

0.11.4

29 release files

0.11.3

29 release files

0.11.2

26 release files

0.11.1

26 release files

0.11.0

26 release files

0.10.3

17 release files

0.10.2

41 release files

0.10.1

41 release files

0.10.0

41 release files

Pre-release

0.10.0rc1

41 release files

0.9.4

41 release files

0.9.3

17 release files

0.9.2

17 release files

0.9.1

17 release files

0.9.0

17 release files

Pre-release

0.9.0rc2

17 release files

Pre-release

0.9.0rc1

17 release files

Pre-release

0.9.0.dev4

17 release files

Pre-release

0.9.0.dev3

17 release files

Pre-release

0.9.0.dev2

17 release files

Pre-release

0.9.0.dev1

17 release files

Pre-release

0.9.0.dev0

17 release files

0.8.1

17 release files

Pre-release

0.8.1rc2

17 release files

Pre-release

0.8.1rc1

17 release files

0.8.0

17 release files

Pre-release

0.8.0rc4

17 release files

Pre-release

0.8.0rc3

17 release files

Pre-release

0.8.0rc2

17 release files

Pre-release

0.8.0rc1

17 release files

Pre-release

0.8.0.dev2

17 release files

Pre-release

0.8.0.dev1

17 release files

Pre-release

0.8.0.dev0

17 release files

0.7.0

17 release files

Pre-release

0.7.0rc7

17 release files

Pre-release

0.7.0rc6

17 release files

Pre-release

0.7.0rc5

17 release files

Pre-release

0.7.0rc4

17 release files

0.6.0

17 release files

0.5.2

13 release files

0.5.1

13 release files

0.5.0

13 release files

0.4.2

13 release files

0.4.1

13 release files

0.4.0

13 release files

0.3.0

13 release files

0.2.1

13 release files

0.2.0

13 release files

0.1.1

13 release files

0.1.0

13 release files

0.0.13

13 release files

0.0.12

13 release files

0.0.11

13 release files

0.0.10

13 release files

0.0.9

13 release files

0.0.8

13 release files

0.0.7

13 release files

0.0.6

13 release files

0.0.5

13 release files

0.0.4

13 release files

0.0.3

13 release files

0.0.2

13 release files

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page