Tokenizer for NLP

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for tommasofacchin from gravatar.com tommasofacchin

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT License
  • Author: Tommaso Facchin
  • Requires: Python >=3.8
Report project as malware

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for tommasofacchin from gravatar.com tommasofacchin

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT License
  • Author: Tommaso Facchin
  • Requires: Python >=3.8

Release history Release notifications | RSS feed

0.1.9

0.1.8

0.1.7

0.1.6

This version

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ft_tokenize-0.1.5-cp314-cp314t-musllinux_1_2_x86_64.whl (1.7 MB view details)

Uploaded CPython 3.14tmusllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (664.5 kB view details)

Uploaded CPython 3.14tmanylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp314-cp314-musllinux_1_2_x86_64.whl (1.6 MB view details)

Uploaded CPython 3.14musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (587.8 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp313-cp313-musllinux_1_2_x86_64.whl (1.6 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (513.0 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp312-cp312-musllinux_1_2_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (438.2 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp311-cp311-musllinux_1_2_x86_64.whl (1.4 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (363.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp310-cp310-musllinux_1_2_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.10musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (290.4 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp39-cp39-musllinux_1_2_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.9musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (218.6 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

ft_tokenize-0.1.5-cp38-cp38-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.8musllinux: musl 1.2+ x86-64

ft_tokenize-0.1.5-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (146.2 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

File details

Details for the file ft_tokenize-0.1.5-cp314-cp314t-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp314-cp314t-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 ca70e3e010c5e45b020dfc7826d4b9c1cfe7f82ca80b6e16fbcf9f6cb2d37d9f
MD5 3e7b56eae97a9f06f7cbbe6dc6b66258
BLAKE2b-256 a3fc6ecdb47aa6617e91a0d7e940b536da6c7c143674e6182f154f75fef940da

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp314-cp314t-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 9d4314fc51ddbc407d5276341aba6fc0dc138c20833401478eda5dc299673c20
MD5 4863bc85fc98c56330b737be6b7a9433
BLAKE2b-256 ac0e0161ca334913c441147c516873a5d94fd8905a35bcddb705f714e5d40242

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp314-cp314-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp314-cp314-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 a405cecf268339826ebda4b21d5f2a2d4a73c7843407bbe6c149189b429cba71
MD5 b68e935ef2810284eed449e7c6e06446
BLAKE2b-256 8b3e6aa8fc86299a928497e697a1b5e1387788f3e53f3357ed85185c53c3cb7c

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 07165cc454e59590bcbb2d54921da73441d9985a360a2eaec781b4d841a2125a
MD5 235dae4cbfc739f6f33efaa73455a416
BLAKE2b-256 f1b3e5832580cfe1baf3b5f6e3eb39c52326bef43960c38239058abc77b660f8

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 90f54077054eb74c187c9f179baf92eec661521711638c57c648e0aa3bf63bec
MD5 2802c36fb97ad0c5eff617a282198152
BLAKE2b-256 4163518aef5ff2ff48e64bc1b232b3c0cb1d779c28d66a0dcf76892975c1bcd0

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 d5dfd22d854cb1c16eefc84628405a90c45276c0c4d42b7a2c99032ec11851ec
MD5 591adeb7ccb841065cc7e31e4d4ddf34
BLAKE2b-256 8db933f569cdd52966931dbabd79614beb39c323db1b122081d21826d49f2940

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 c2ac482b65c6f8e58e476526a2daeafd2f5b66e20064721c918af66d09d94d86
MD5 df83ff7d44e3ea96ec306c14068a8eec
BLAKE2b-256 e26c6dd31eca906406c3a500f1a9f38d7e8f925802dc92a1667f707b02553193

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 5a00566f1d816335e832fdaaabb24ef1925b5a49a647a7b257905f7175f984cc
MD5 30a9da522cd6b36738c4b8b167230c74
BLAKE2b-256 080b4d810d5ba8265c7ba5500025013ff30645285b988211a63eac188ff9111a

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 22230eb93e7414b1137f4a892ad0faf68de1dbda3c09e26c2dbe9ba5f2d5c5f8
MD5 92ae1a2137d7286a786eb5ca60397ae0
BLAKE2b-256 9dbc071fea04c9d4ec7d7be96e2ae8485546a430fbf0ff5b9bf60ec8aca30c23

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6392521ef25b16be2e094917d94b89daf8d2c9ba5d61a378cf640cbfc5fff328
MD5 9f84d5a58dcaa6c03e134022737b6d59
BLAKE2b-256 c6cba06dadbf290fc830e2c219766b2ae123c65cd39356db93a1a1c80b088944

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp310-cp310-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp310-cp310-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 d349ce7443f5892f574bb7e39c4c8bf9b0e57358bdc75dd918c29d4b60fdf288
MD5 b9cb7844e1b6ba10b06c0f981918dea8
BLAKE2b-256 8597f334934c6352994dc15f1d2dd45706bfd3b627eee8344728ad95e90e91b8

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp310-cp310-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 59a3394c916c78aefdca6faee71d5661d1ddd6ff44e075f8f3d1ef18f157aa63
MD5 ec49b493f7ed0f11935b9b632f4308b1
BLAKE2b-256 55b562cc6ba2fe30258d5e3de27d122b08753160a1766364963c1569a6ec3673

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp39-cp39-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp39-cp39-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 de4ab5c75ca367c7a97805dc8f5c78346be00f9dd7a3bfb76e367f4f45cb8154
MD5 734b27599eb25ee49a08e445cdf230b1
BLAKE2b-256 8ff57fb988488a773a646262428b73056a1e10c6c8d10b0d1147b8915a73fea9

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp39-cp39-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 53464385ae0cf69089797b2fdca674df909b7393a332718a34e114f049ca2715
MD5 b4eb62435f2f71f39e3e59bbfdbebfbd
BLAKE2b-256 957b4903347ffbc0af5d0665c96e460c9012d35df6e84c22ebdc5d93a314176d

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp38-cp38-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp38-cp38-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 50515d08e90363bed28b47b23c7c56ed36d0ba8bce03f4735858c294f5019a61
MD5 ecd4fd20d8c061b80fff2e4a24e35163
BLAKE2b-256 7f661c0cee75748de44d123e734eb268d4e48f007dfd63e7b51e227002854764

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.5-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.5-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 b1a66067e02bf6df09e8f2ceabe14b442dd4fb70ed1c2844cf6b5fa5f65e52f3
MD5 8e9d1c02de9b190a2056571d0d00e79f
BLAKE2b-256 95aa8fb66c9f1e3d46be1014b055a1cdd9240c6a3004a9743e6a9c30ea0aa654

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page