Skip to main content

PaddleNLP Faster Tokenizer Library written in C++

Metadata

Release files for faster-tokenizer 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for faster-tokenizer 0.2.0
File
faster_tokenizer-0.2.0-cp39-cp39-win_amd64.whl CPython 3.9 CPython 3.9 Windows x86-64 Details
faster_tokenizer-0.2.0-cp39-cp39-manylinux1_x86_64.whl CPython 3.9 CPython 3.9 Linux glibc 2.5+ x86-64 Details
faster_tokenizer-0.2.0-cp39-cp39-macosx_10_14_x86_64.whl CPython 3.9 CPython 3.9 macOS 10.14+ x86-64 Details
faster_tokenizer-0.2.0-cp38-cp38-win_amd64.whl CPython 3.8 CPython 3.8 Windows x86-64 Details
faster_tokenizer-0.2.0-cp38-cp38-manylinux1_x86_64.whl CPython 3.8 CPython 3.8 Linux glibc 2.5+ x86-64 Details
faster_tokenizer-0.2.0-cp38-cp38-macosx_10_14_x86_64.whl CPython 3.8 CPython 3.8 macOS 10.14+ x86-64 Details
faster_tokenizer-0.2.0-cp37-cp37m-win_amd64.whl CPython 3.7 CPython 3.7 pymalloc Windows x86-64 Details
faster_tokenizer-0.2.0-cp37-cp37m-manylinux1_x86_64.whl CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.5+ x86-64 Details
faster_tokenizer-0.2.0-cp37-cp37m-macosx_10_14_x86_64.whl CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64 Details
faster_tokenizer-0.2.0-cp36-cp36m-win_amd64.whl CPython 3.6 CPython 3.6 pymalloc Windows x86-64 Details
faster_tokenizer-0.2.0-cp36-cp36m-manylinux1_x86_64.whl CPython 3.6 CPython 3.6 pymalloc Linux glibc 2.5+ x86-64 Details
faster_tokenizer-0.2.0-cp36-cp36m-macosx_10_14_x86_64.whl CPython 3.6 CPython 3.6 pymalloc macOS 10.14+ x86-64 Details

Total release size: 162.2 MB

Release files / faster_tokenizer-0.2.0-cp39-cp39-win_amd64.whl

Download URL faster_tokenizer-0.2.0-cp39-cp39-win_amd64.whl
Size 13.8 MB
Tags CPython 3.9 Windows x86-64
SHA-256 checksum
How to use checksums
b1d22991d8a31191fa00d0dfeb9828890b852728c7a389dda452f6d7c568bc90
BLAKE2b-256 checksum
How to use checksums
efad4adb133c884cf260b085cb072dccaff1aa4aa6c18b8550d525d309037377
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.7

Release files / faster_tokenizer-0.2.0-cp39-cp39-manylinux1_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp39-cp39-manylinux1_x86_64.whl
Size 13.6 MB
Tags CPython 3.9 Linux glibc 2.5+ x86-64
SHA-256 checksum
How to use checksums
870e8f0405ce42883942f35da52a38dcaa62425905b87ea244d85ead521c9a7f
BLAKE2b-256 checksum
How to use checksums
60df6f344d098d15a91ee64d8d6b54da6803efd5d4e18a965bd50d8f4ce4a94c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.3 readme-renderer/34.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.64.0 importlib-metadata/4.8.1 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.0

Release files / faster_tokenizer-0.2.0-cp39-cp39-macosx_10_14_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp39-cp39-macosx_10_14_x86_64.whl
Size 13.2 MB
Tags CPython 3.9 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
ddf33d7ec4a55dd20881986515968c87f14a313370b1012917f10280c7ab0856
BLAKE2b-256 checksum
How to use checksums
dfe6b87e369e780f066d8b99784630238ce930f7ec376b2334d74c5d166da438
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.0

Release files / faster_tokenizer-0.2.0-cp38-cp38-win_amd64.whl

Download URL faster_tokenizer-0.2.0-cp38-cp38-win_amd64.whl
Size 13.8 MB
Tags CPython 3.8 Windows x86-64
SHA-256 checksum
How to use checksums
e696c95219bbff0e044b49cc66d9a8796cb6bc3fae6aea760c87c396c80704eb
BLAKE2b-256 checksum
How to use checksums
4bdf040dbdc24f5dd7a8326abc610ece64c75b9d09678c5260e12bc4c211d3ca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.7

Release files / faster_tokenizer-0.2.0-cp38-cp38-manylinux1_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp38-cp38-manylinux1_x86_64.whl
Size 13.6 MB
Tags CPython 3.8 Linux glibc 2.5+ x86-64
SHA-256 checksum
How to use checksums
a2ab4cecdde66a2e201775024497bedb48989ee64adcca0e1dd058928a3335e0
BLAKE2b-256 checksum
How to use checksums
3b7e5c9ab53a4ed93cc00651cb244726775cc9dd0210ef00167760e05ecab6e9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.3 readme-renderer/34.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.64.0 importlib-metadata/4.8.1 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.0

Release files / faster_tokenizer-0.2.0-cp38-cp38-macosx_10_14_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp38-cp38-macosx_10_14_x86_64.whl
Size 13.2 MB
Tags CPython 3.8 macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
1ed015275280314c95d72b6d56ad5b258e4f8bdcaf474cf2f8f563e2bf8ab798
BLAKE2b-256 checksum
How to use checksums
851e0156cb6179382123de93463ae87f1137f381654fb19a3bc777d375a0ad2e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.0

Release files / faster_tokenizer-0.2.0-cp37-cp37m-win_amd64.whl

Download URL faster_tokenizer-0.2.0-cp37-cp37m-win_amd64.whl
Size 13.8 MB
Tags CPython 3.7 CPython 3.7 pymalloc Windows x86-64
SHA-256 checksum
How to use checksums
549db6a6f2c3636311d858cb3e998135b90998fed7fe8ac0bc07b6e318af5d80
BLAKE2b-256 checksum
How to use checksums
0f7b1d929dfa656efc5bbac8eb86705ac86c5e23a4258098adfebbab70995747
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.7

Release files / faster_tokenizer-0.2.0-cp37-cp37m-manylinux1_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp37-cp37m-manylinux1_x86_64.whl
Size 13.6 MB
Tags CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.5+ x86-64
SHA-256 checksum
How to use checksums
e9f2dd83be7329585258fd345b3e94cff25cdb2661c0d1762e46c503bda82914
BLAKE2b-256 checksum
How to use checksums
f17fec308520cf3c0d2904eb2630d66fcba9bca053d2d4d78da00aaa9408a97a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.3 readme-renderer/34.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.64.0 importlib-metadata/4.8.1 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.0

Release files / faster_tokenizer-0.2.0-cp37-cp37m-macosx_10_14_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp37-cp37m-macosx_10_14_x86_64.whl
Size 13.2 MB
Tags CPython 3.7 CPython 3.7 pymalloc macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
8ae258fca0e76015af9a5b548b0e645f28270855728931342f7d31bc2b3861b1
BLAKE2b-256 checksum
How to use checksums
cb61706d876208c9fa318230df5fc59ba95722e135f4928d2f85a49331985b9d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.0

Release files / faster_tokenizer-0.2.0-cp36-cp36m-win_amd64.whl

Download URL faster_tokenizer-0.2.0-cp36-cp36m-win_amd64.whl
Size 13.8 MB
Tags CPython 3.6 CPython 3.6 pymalloc Windows x86-64
SHA-256 checksum
How to use checksums
04b6bcbc0dfc2b55b9d5eb0c163715ef50838a31072487e662f38d8402736229
BLAKE2b-256 checksum
How to use checksums
692136e289dc9d57c194fe8619a5fe237ed67c3a8bd6f4775cbc1426a1d56b79
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.7

Release files / faster_tokenizer-0.2.0-cp36-cp36m-manylinux1_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp36-cp36m-manylinux1_x86_64.whl
Size 13.6 MB
Tags CPython 3.6 CPython 3.6 pymalloc Linux glibc 2.5+ x86-64
SHA-256 checksum
How to use checksums
c68430dd234ca85ade76b7e88890304f3d810eae98b789a8bc6bf150d9d4ab87
BLAKE2b-256 checksum
How to use checksums
9df50d6f6009be30ab295e66e4aba51335c3ed07e4cfda3332a3b878f7cba6ce
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.3 readme-renderer/34.0 requests/2.26.0 requests-toolbelt/0.9.1 urllib3/1.26.7 tqdm/4.64.0 importlib-metadata/4.8.1 keyring/23.4.1 rfc3986/1.5.0 colorama/0.4.5 CPython/3.6.0

Release files / faster_tokenizer-0.2.0-cp36-cp36m-macosx_10_14_x86_64.whl

Download URL faster_tokenizer-0.2.0-cp36-cp36m-macosx_10_14_x86_64.whl
Size 13.2 MB
Tags CPython 3.6 CPython 3.6 pymalloc macOS 10.14+ x86-64
SHA-256 checksum
How to use checksums
13f04c5295df2d2bcd4f7ff3f93160510f6643fe411ded4b4cbb57f15bbf165f
BLAKE2b-256 checksum
How to use checksums
a11040f6b2652203a3fe2b13e840600d665f0edc9a10bce444195fa2ff4ed253
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.0

Release history Release notifications | RSS feed

This release

0.2.0 This release

12 release files

0.1.6

13 release files

0.1.5

8 release files

0.1.4

8 release files

0.1.3

4 release files

0.1.2

4 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page