This is description

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nishantbaheti from gravatar.com nishantbaheti

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Nishant Baheti
  • Tags tokkit
  • Requires: Python >=3.10
  • Provides-Extra: dev , test
Classifiers
Report project as malware

Project description

tokkit

Python API tokenizer with power of C++

Development Guidelines

Ubuntu System

update g++ to support c++17

sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
sudo apt update 
sudo apt install g++-13
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-13 100

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for nishantbaheti from gravatar.com nishantbaheti

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Nishant Baheti
  • Tags tokkit
  • Requires: Python >=3.10
  • Provides-Extra: dev , test
Classifiers

Release history Release notifications | RSS feed

0.0.5

This version

0.0.3

0.0.2

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

tokkit-0.0.3-cp312-cp312-musllinux_1_2_x86_64.whl (1.6 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

tokkit-0.0.3-cp312-cp312-musllinux_1_2_i686.whl (1.6 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ i686

tokkit-0.0.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (506.4 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64

tokkit-0.0.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl (490.7 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ i686

tokkit-0.0.3-cp312-cp312-macosx_11_0_arm64.whl (112.4 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

tokkit-0.0.3-cp312-cp312-macosx_10_13_universal2.whl (159.7 kB view details)

Uploaded CPython 3.12macOS 10.13+ universal2 (ARM64, x86-64)

tokkit-0.0.3-cp311-cp311-musllinux_1_2_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

tokkit-0.0.3-cp311-cp311-musllinux_1_2_i686.whl (1.6 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ i686

tokkit-0.0.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (501.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64

tokkit-0.0.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl (485.7 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ i686

tokkit-0.0.3-cp311-cp311-macosx_11_0_arm64.whl (112.3 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

tokkit-0.0.3-cp311-cp311-macosx_10_9_universal2.whl (159.4 kB view details)

Uploaded CPython 3.11macOS 10.9+ universal2 (ARM64, x86-64)

tokkit-0.0.3-cp310-cp310-musllinux_1_2_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

tokkit-0.0.3-cp310-cp310-musllinux_1_2_i686.whl (1.6 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ i686

tokkit-0.0.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (486.0 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64

tokkit-0.0.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl (472.4 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ i686

tokkit-0.0.3-cp310-cp310-macosx_11_0_arm64.whl (112.3 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

tokkit-0.0.3-cp310-cp310-macosx_10_9_universal2.whl (159.4 kB view details)

Uploaded CPython 3.10macOS 10.9+ universal2 (ARM64, x86-64)

File details

Details for the file tokkit-0.0.3-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 034e8f3cdcbab4a9c3e999fb534aef90793b94e69e8cd8de9183bb262e3a9ae2
MD5 d127e91f0aa2cf3916699d05dafa2cfd
BLAKE2b-256 9a4f1a5c7370564d14549ef29e09d4e6dad164738390230d7f7198808749f8b7

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp312-cp312-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 f090db2305891fcb0b2ed8644ef3b23c48c2b9cf7e1914565d797faf9968e28b
MD5 648afef2f5af06107f9a71f77927393c
BLAKE2b-256 234deaa9f694addd23a83d48c96b1bed447e18d800bdf5a595332b98a5e5f554

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 aebf45938c2cc7f9b1fd1c5b97142a6e3a76198292bee08d91edd51ea540d173
MD5 7bd574f5d00221ffadc6a14c34914c23
BLAKE2b-256 0e85a65d0ccec8b2d8a26b1991a3a47d956e5ed4f1c20d5f99148162e883784f

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 e1577902058705617afbaca04152e6854ab69af20560a6736cf4e6bddee1cb47
MD5 7d848bd37df0d318d60416f695630027
BLAKE2b-256 5c75aa97669b469ac4217afa465fcf519f88442481e54cb8fc8e2ff506ab35c6

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 8efa1b5553d7537a1d9cc6c69a4b8be3f0106d5512139dc185566ea506969033
MD5 ded9f4760bd8f0a01e7a12ca3cec4e69
BLAKE2b-256 b2e88a493e1fbe1772fa3719c4939ebf2c1df1e2ca8b4de45e511b4daabbadd9

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp312-cp312-macosx_10_13_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp312-cp312-macosx_10_13_universal2.whl
Algorithm Hash digest
SHA256 b6886a6b77d660238186fc7eb83c41894afadb12576aba3fa58b88c69fe22c0d
MD5 e16f4a3cdc29f61f49e2eb9433f63810
BLAKE2b-256 737baf2bca2ad8daa9fffb1c7b9e0fc83c858b9cd6da74ce12570bae788881a0

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 389d7532cd86053d66332ef6e4e655809bdcec6342501d0118d03c6f528ddef1
MD5 f4d10f9c575952cbfd03617b7317dcfa
BLAKE2b-256 9c4283c966151c9a0461cc2580943b0c3fdd214b6c67bd446b5e3c35d4b8183b

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 7e95130989f47a5b3b0c0a9ebce08c401e593dbf60f4ecef3a981aa90a820f9d
MD5 5423619c8a61002d78e3893bc8ce76bd
BLAKE2b-256 282b294e65cb77c006e6326b0ddc37b9b87541988591090e491eedc5f3a53b4e

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a3abcdb33a7049cc4c0946b2c0564390c10e6989e83b226f639c9d857d3d2cd1
MD5 4c9d6ea38af753d994007a4e42896eac
BLAKE2b-256 22a2bb988efa35eab72835bc897dafde144d458808ebd49f64ed4c825c3e01a7

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 b10e86485e6fb83a914f2e343bf798a007f4eb922c5e9e0abb9e8419576d7899
MD5 e61bc5ccd3f93d17c3cfdf98a807e461
BLAKE2b-256 bfaa00ccc991f719f6367068471c82b46869790701944ab76e4463cc5dd9d6b3

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 890e0ee39e048c5021886d922ca8fc4310a3360f271ec13b849707523c3acc12
MD5 9043f2a8135f19c3d1f78efa429c5b0e
BLAKE2b-256 280e510faf56bf4a8d8d15acbe44e0fe858668c0005cb58c5f3638166bdc27e8

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp311-cp311-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp311-cp311-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 401bbe2e8871762c2b77ecd527c15f4f7954f48c321fccc23948b926c0ba5d1a
MD5 3625ec4dd4530d7ed34762e75d42f08f
BLAKE2b-256 1a8dee4ed72a55274de14e70f413a4fdffe794621d2906582e315ad5594c0ec4

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 d7a4da669756055a01639e12a700a4fb39699f845dbbda96dbe0fdd27f04b27e
MD5 16ac822bfbf6c73ee50ad43200f50df8
BLAKE2b-256 64c45ac92c51e140a3cafb59595384e961c27062f1fe60570057c93c5e603653

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-musllinux_1_2_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-musllinux_1_2_i686.whl
Algorithm Hash digest
SHA256 92bc768e07ced96dfc5003cec849c5e2157eb9aa9d0e0b1131f1e9151a89a7f9
MD5 fda09fde1fbf19a51c5687853676b0d5
BLAKE2b-256 6332222c821bb6e6ba7fff1abfd493282ddff305c6812712bc735bed063433be

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d448b5e18df5ef82d361c4f93929d05effc5802f47c6d4aa83214782d7607cc7
MD5 bcf6150703fae67750e4b35a0f394ac1
BLAKE2b-256 82d7781cf3597a84bd1e72e8bbfbe5c7662d76c2c65123a471d7263b2ab1bd4a

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm Hash digest
SHA256 2569572196aea9df4c6b5e54493e08d3f6b4c2a8255dbc6cdb9c1889f65acd56
MD5 a8451a279985baebbb55ed1e70872c5b
BLAKE2b-256 6d7d675faf37c8ce708f26cc73abb83426a89825846718e85263f51968fff4e3

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 1c49a8f2faa2bb6ff7bd640b36d2291593a47ec4c529e075f6967e27ccb46309
MD5 23d6d1e228bf0d75786f4f4b98e932ad
BLAKE2b-256 c5d65c2baece7a45957a625154cf1c6286620ffd73ca355efe276491b33a84e7

See more details on using hashes here.

File details

Details for the file tokkit-0.0.3-cp310-cp310-macosx_10_9_universal2.whl.

File metadata

File hashes

Hashes for tokkit-0.0.3-cp310-cp310-macosx_10_9_universal2.whl
Algorithm Hash digest
SHA256 f6601f013490e6c7f0ed3bba435388cf67a5790ac152844791ff786dfc94eef0
MD5 80c587e18db30936642159068859a97c
BLAKE2b-256 c2aa4aeddf3227009c3a19e7bf159f74fdec27dc1fb70bb5bdb5a6dd6ae7cb47

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page