This is description

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nishantbaheti from gravatar.com nishantbaheti

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Nishant Baheti
  • Tags tokkit
  • Requires: Python >=3.10
  • Provides-Extra: dev , test
Classifiers
Report project as malware

Project description

tokkit

Python API tokenizer with power of C++

Development Guidelines

Ubuntu System

update g++ to support c++17

sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
sudo apt update 
sudo apt install g++-13
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-13 100

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nishantbaheti from gravatar.com nishantbaheti

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Nishant Baheti
  • Tags tokkit
  • Requires: Python >=3.10
  • Provides-Extra: dev , test
Classifiers

Release history Release notifications | RSS feed

This version

0.0.5

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

tokkit-0.0.5-cp312-cp312-musllinux_1_2_x86_64.whl (1.6 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

tokkit-0.0.5-cp312-cp312-musllinux_1_2_i686.whl (1.7 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ i686

tokkit-0.0.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515.3 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

tokkit-0.0.5-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (499.8 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ i686

tokkit-0.0.5-cp312-cp312-macosx_11_0_arm64.whl (115.6 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

tokkit-0.0.5-cp312-cp312-macosx_10_13_universal2.whl (164.3 kB view details)

Uploaded CPython 3.12macOS 10.13+ universal2 (ARM64, x86-64)

tokkit-0.0.5-cp311-cp311-musllinux_1_2_x86_64.whl (1.6 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

tokkit-0.0.5-cp311-cp311-musllinux_1_2_i686.whl (1.7 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ i686

tokkit-0.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (508.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

tokkit-0.0.5-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (495.1 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ i686

tokkit-0.0.5-cp311-cp311-macosx_11_0_arm64.whl (115.5 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

tokkit-0.0.5-cp311-cp311-macosx_10_9_universal2.whl (164.0 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

tokkit-0.0.5-cp310-cp310-musllinux_1_2_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

tokkit-0.0.5-cp310-cp310-musllinux_1_2_i686.whl (1.6 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ i686

tokkit-0.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (494.5 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

tokkit-0.0.5-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (482.7 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ i686

tokkit-0.0.5-cp310-cp310-macosx_11_0_arm64.whl (115.5 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

tokkit-0.0.5-cp310-cp310-macosx_10_9_universal2.whl (163.9 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file tokkit-0.0.5-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 68c9cabc1f69ccc09fc136d3fd9587e87ef9b817e6221b1ee7bfcebe24f1b70b
MD5 b38ea999062931807f08b6756395c505
BLAKE2b-256 2143c0a8ca26a435ebaeebed959025a60140671aa017ffb667948b45195f2536

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp312-cp312-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 78b543dd53b02ffdcdaf04502848cc59da89b4a08ca4a2f73c86ed228ff41392
MD5 bb91b548ab3b664ec986a655d1bc7b82
BLAKE2b-256 761c7b1e0051c9d2ae7a49b10cf1182bf4abb94212961ef1e9a9553e7a8ff2b6

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 475071266831054ee031906f1a6a3a9f21d1793cbe78dffa8f1445921d6fc68d
MD5 de5ffe4bcb9199f72e5d3373a43f0692
BLAKE2b-256 abe893358eabffd5f8545c0e881e35578fd370d4ccd30d8709606378abb80c6f

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 d1f299e36a2706834db4f21e25b5c5655f4a620075d6df8f5427f8c4cd0aff38
MD5 118e85976a6b04f474bda611b6aeb59c
BLAKE2b-256 0e07e092a6dad1ed7ebc388cc1023882197fde4e87af0dc01dd56ea3dda023c1

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1676476aef3891ee9af406c294582716f87f501ad3dd860bd303af472ecf7e73
MD5 a2bd9d0cfd78e5afb419dd6fd6c2e1ee
BLAKE2b-256 5334e648c52ba83789251c6355e2c35cae49b35dfbc2aa452de8442bc17c03d8

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp312-cp312-macosx_10_13_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp312-cp312-macosx_10_13_universal2.whl
Algorithm Hash digest
SHA256 6b0d2073ab185cc6004ad4386bab1f1b6d7e755624bcb8ab5678ede9ded36d96
MD5 51adac07b226871c764ae1d24c4a18fb
BLAKE2b-256 ce81143dfe170f4243c17d2a3acaf5ed7df3a2f12ff9b4c250b7d5d2dbab4081

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 fdb4434aaafc2fe05267d1b7b58cf8595978bff3d3c984436afd0447f115372b
MD5 80f3fda44accbb76eb408cc7bf9d48d6
BLAKE2b-256 7f23118f942ad46f8549751686680aeb33cadbfb2423c994cdd28e2d74b27869

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 fc63552b031f3d254c52668356fcfc2a87fc79e1499af28c201a792f504b9597
MD5 f60c42fb2673e3a6c265912326f62e0f
BLAKE2b-256 e04d7f0b939960afd751f6d8151c7893fd1928221bc415188d3bb2519a3c48e7

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 e5cbebdc27b656eb79dd983000d8fee1e2f4a4f6a9668c07f5da47bd7023daad
MD5 27c1a56380a2400756258f0a0fdc9549
BLAKE2b-256 af69b285d1339fa6098ffe48d1a84a7175b2a5b2c17bedbffd701243b48e0b62

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 65fa74428d6679579961f49e2ce3e215678ccfdea72f08deb3c49add1f801638
MD5 dfc2ebf83739bbce3458844b078eb8bb
BLAKE2b-256 dcda7b3801320d9d053cdea16295e6892e9061ee734ddbed5892cb971cdb840d

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 4b601f68a715ed29d5eb0cc40d2ae08c105f8d08abb37a2457d00f029fbad14b
MD5 0cd815f2c9a501fe7f9eeec766db5ae3
BLAKE2b-256 a7723d22582bcf1ce874f0df12071ddc645791e2f9cce09b5e5831d49d9e7adf

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 fb55d0bfd5807cabeaff0487ee65e3c08adfa22b83c15363599d4f44663379a6
MD5 7c228d8b8284d1db9a69e652eb498c6f
BLAKE2b-256 37b656f210de187ed8c00f2cd5daf9e6c66b2327d099eade9cf827223fe42e53

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 1717cf02079d12b7ea3b0cbce880f4561428d3049beba2e72b064fe928420022
MD5 481d7d4201782fa548565fa75db45497
BLAKE2b-256 4a622a6569f4a06a8cab00fae726e3a7af47467926f0976bfda49b4eeffddc97

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 4525952cebc6bb4f3fb37448b06eb6863f19f0a05bff4f09f1222aa3348ad8b1
MD5 4aa887bc724bb73b1e7c2861b1bd0177
BLAKE2b-256 984afb668cd3ff5a775334b51abb7ed72534612f64182c3c629d079d16e551d8

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b3b552d750fc53fa3c72b53601e82f043ccbece78301428c5a30455d2861ef01
MD5 667b421dfd8160bf679030932525d8e0
BLAKE2b-256 b3ad881129e8927d2b7ad7dfedff08fccceae465cac76415490d3383c1e8a9aa

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 6f2c71696ef26f55118fb73f4c52825b86cfe5110c994229c36ed6c89db7d572
MD5 3a357e85afd8688ebf5724fe3c62b5ac
BLAKE2b-256 d12b92d2107ce6db1f3ff4506d5f606b9f9969111c90889e242e78ad253d5512

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f78b28d4221d6dc58818138cf41eab743b4587f12b0f3997b5a0b02aec77e8e7
MD5 49be866c69ae40862c88ad947da70570
BLAKE2b-256 89d7e4a29fd26f8f1fb03be3826bd458615175d84647a6e0c413eaa61b1ef459

See more details on using hashes here.

File details

Details for the file tokkit-0.0.5-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.5-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 f7149fe1802ea057c69425b7b172b9e08c84ef91fa70448678aade4916eb5287
MD5 58930044e4c21c53e1c3bd9ea1107684
BLAKE2b-256 7872b4973944773eed1bdae12f369e6203ca4e305468874151a15b5bbe73f44e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page