Skip to main content

Tokenizer for NLP

Project description

ft-tokenizer

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ft_tokenize-0.1.1.tar.gz (6.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ft_tokenize-0.1.1-cp313-cp313-win_amd64.whl (2.4 kB view details)

Uploaded CPython 3.13Windows x86-64

File details

Details for the file ft_tokenize-0.1.1.tar.gz.

File metadata

  • Download URL: ft_tokenize-0.1.1.tar.gz
  • Upload date:
  • Size: 6.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for ft_tokenize-0.1.1.tar.gz
Algorithm Hash digest
SHA256 deac00744506a78383ee64254790c5f1b965ef64ffd6e172d0ccf55058be82f7
MD5 827edb1ab03a7b483c929b75b7dc2f96
BLAKE2b-256 b6d63e201df7636844be40204366c5c9a31512eab6e35d9d054a281542c72672

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 e19dd49ce5f96f4ffe9404e18bb5d06d67cb231d9087757c26ab867af0b7f691
MD5 0a282fbc760d41b5ecaba6374e500a65
BLAKE2b-256 3d2a232347c4b84bfb034c40dc711234ee19c9c35954c3b4ac41c36f288c18f9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page