Blazingly fast tokenizer — 50x faster, 10x smaller, 100% accurate

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for bhavnicksm from gravatar.com bhavnicksm

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT OR Apache-2.0
  • Requires: Python >=3.9
Classifiers
Report project as malware

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for bhavnicksm from gravatar.com bhavnicksm

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT OR Apache-2.0
  • Requires: Python >=3.9
Classifiers

Release history Release notifications | RSS feed

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

This version

0.0.3

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

tokie-0.0.3-cp313-cp313-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.13Windows x86-64

tokie-0.0.3-cp313-cp313-manylinux_2_34_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ x86-64

tokie-0.0.3-cp313-cp313-macosx_11_0_arm64.whl (1.7 MB view details)

Uploaded CPython 3.13macOS 11.0+ ARM64

tokie-0.0.3-cp312-cp312-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.12Windows x86-64

tokie-0.0.3-cp312-cp312-manylinux_2_34_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64

tokie-0.0.3-cp312-cp312-macosx_11_0_arm64.whl (1.7 MB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

tokie-0.0.3-cp311-cp311-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.11Windows x86-64

tokie-0.0.3-cp311-cp311-manylinux_2_34_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64

tokie-0.0.3-cp311-cp311-macosx_11_0_arm64.whl (1.7 MB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

tokie-0.0.3-cp310-cp310-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.10Windows x86-64

tokie-0.0.3-cp310-cp310-manylinux_2_34_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.34+ x86-64

tokie-0.0.3-cp310-cp310-macosx_11_0_arm64.whl (1.7 MB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

tokie-0.0.3-cp39-cp39-win_amd64.whl (1.6 MB view details)

Uploaded CPython 3.9Windows x86-64

tokie-0.0.3-cp39-cp39-manylinux_2_34_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.34+ x86-64

tokie-0.0.3-cp39-cp39-macosx_11_0_arm64.whl (1.7 MB view details)

Uploaded CPython 3.9macOS 11.0+ ARM64

File details

Details for the file tokie-0.0.3-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: tokie-0.0.3-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokie-0.0.3-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 c2e030a79c50fc9ddd4349652d770c7b11af929cfddfd28aa54850fcfe689bda
MD5 b4e2490a1bfccd4b408332d2e4361213
BLAKE2b-256 b0406c40fa1a571d916e761b5db3db97769cea928870c269b3ebe8227360033b

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp313-cp313-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp313-cp313-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 cc16f4b1d8eb0f346b369c62c98c9da74a8b8b049e8b7b05fae87c0678ed18e0
MD5 4e3399662c9703d41fc1ab8484078994
BLAKE2b-256 f3a105dad534d239f9f5c2a92245e4342e269c2f1767000b246c185d42ad81ac

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp313-cp313-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp313-cp313-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1aa87cc69cb3179ab433b80bcd11df8af2dd978f7c230cabfcf2f6c2a7d072bb
MD5 d94bbe3bb915472bb1c6c78cad0efb19
BLAKE2b-256 b58fd267741e27547bc73c9d5947e5b6569a2025241938edf93b7498752aa3d7

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: tokie-0.0.3-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokie-0.0.3-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 3f01113975d9d076480ac992a7c116acd9e77c3d12cea73222e96f35174b2492
MD5 36739159b7089816205bfd03ef8f153d
BLAKE2b-256 fa19b17dfc60cbd16af3f06e66b4789d7e39494956a2ef9d2ac2eae0bc73eb6d

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp312-cp312-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp312-cp312-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 8e35a3b7e5ff741a34c47fc2e4320dc7e2e24438113412c55aaac4dfbc06ad5d
MD5 4d4e83753c62f9e7bb7b1776344783c0
BLAKE2b-256 39ef8dd82f71cd92a938e12868319ae968205ea0a3257d3cb49e4a5b0e7af761

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 6dd2bf8b50106aaec775178fc193c128aa92bf06f3c862e226e4b2e74ac18a5d
MD5 608c44687444f787af249cc159b7992f
BLAKE2b-256 388c34602ab633e2b16fc88713ae85df2b679cb64b2a554fcd08c379c98f5e85

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp311-cp311-win_amd64.whl.

File metadata

  • Download URL: tokie-0.0.3-cp311-cp311-win_amd64.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: CPython 3.11, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokie-0.0.3-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 53f27269bd57b1e26be4f4a46319ce735bdea93febb5f936f565097ffcd88dc2
MD5 fa86f2f704d48d186e91fba41865464b
BLAKE2b-256 bda8fb9c1cc0b547544f11e889fd4f02e854991b60d41aae7fa06df51202d06a

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp311-cp311-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp311-cp311-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 96bfb55f5195be48c334e4e91abd42c3fde0ae4442607a64875bcdd621885174
MD5 f0098497e74edee22a1ffa0c55ab1fcb
BLAKE2b-256 eb6dcdb6763607d9f9900187f43447a936d0f0f1c078e0743bffc812ad819843

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a2c6327f0d2747df2be6a431faf6220c93e4f330683c67826669fa8b723187be
MD5 7e4be44e4312bc0c858b6913aa3426a7
BLAKE2b-256 fd736f7fdd7407df2f22afc5556e45f174872a93e2d2132e136222ec893b18c4

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp310-cp310-win_amd64.whl.

File metadata

  • Download URL: tokie-0.0.3-cp310-cp310-win_amd64.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: CPython 3.10, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokie-0.0.3-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 15c577c21aff659f54611b837c5791bd66a807813344357b0a2abbf59f178fd8
MD5 5613e73d828f696261084f3baf3c4974
BLAKE2b-256 565972b8385944f075503800b0748e41c586e65b64bcbea8644fd41281e88b1f

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp310-cp310-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp310-cp310-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 6bbd9b8d8b2ca62c55798d11c254a09484ccbd79e81eaf27850bd2ca59fa7312
MD5 00338145aa2c23c73f3a61a574a1da3e
BLAKE2b-256 4a9a9740ed5b9f3c153a442257820b8ab7109cfcc7a54751bf7a974d18765a47

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 25409ccb4621044aeafc230f15e6173802f41746934d8aae593235c2701722ee
MD5 ab45d6b71dc500c5887552c32baa7bff
BLAKE2b-256 247a157601128afdbe60c45113864ff49be0b88991aaf0ed476864301fcc131e

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp39-cp39-win_amd64.whl.

File metadata

  • Download URL: tokie-0.0.3-cp39-cp39-win_amd64.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: CPython 3.9, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokie-0.0.3-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 8fbf3ed0c5f029a08c4825a55d1d1a2929b783669d2e18e876c68dece82c6a25
MD5 1cdfda961577c59e936dffb851163eb3
BLAKE2b-256 ea6b232b61d75cb0c9d65d020c36b7c7f1c84cd876e719536c93f65adbdc5509

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp39-cp39-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp39-cp39-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 5dcebb215d96a6e01b8ac48a6d05f2b89e909c84541e2744656d0bdb0447a5c6
MD5 4a5d4e6f8b3c2ee152e6aa5016154cf7
BLAKE2b-256 f17d1a15124695b21cc6c63081a536af4db4edf595fa198cb6efd7d28d7ed6ca

See more details on using hashes here.

File details

Details for the file tokie-0.0.3-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokie-0.0.3-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 28c7aee498049ba98084f800e30a9d5e927157b80abd575ee37d7d75c351a1a4
MD5 5ef7422a5bf8419c08b495217c3e7bd3
BLAKE2b-256 18740a0aba228ac3201b325df5edb0619f02d480a2fedb0230ef301bd8383a56

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page