Skip to main content

Tokenizer for NLP

Project description

ft-tokenizer

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ft_tokenize-0.1.3.tar.gz (3.4 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ft_tokenize-0.1.3-cp313-cp313-win_amd64.whl (2.4 kB view details)

Uploaded CPython 3.13Windows x86-64

File details

Details for the file ft_tokenize-0.1.3.tar.gz.

File metadata

  • Download URL: ft_tokenize-0.1.3.tar.gz
  • Upload date:
  • Size: 3.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for ft_tokenize-0.1.3.tar.gz
Algorithm Hash digest
SHA256 7798b5e11fce8731eea3d48e9bba20ff85fae6202dbd2b5bba8b8ace2b51656c
MD5 b71a3dc513c3091e194210edb440be4f
BLAKE2b-256 c88749da67b94dadfb6404f7ca4d29533cf308227ec1b983acfd1a2bc68fb9c0

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.3-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.3-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 dd76eff15dfcf5d9ab766119607977c6df67705373278c8133bdf61c9f88bb32
MD5 bd0ca5d28664128a2fb54d6cd0f3f5c7
BLAKE2b-256 c74c50ee2f495d85e2f87947259d5831cf4f882524149bde2e9b993cfdd3c54a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page