Skip to main content

Tokenizer for NLP

Project description

ft-tokenizer

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ft_tokenize-0.1.2.tar.gz (13.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ft_tokenize-0.1.2-cp313-cp313-win_amd64.whl (2.4 kB view details)

Uploaded CPython 3.13Windows x86-64

File details

Details for the file ft_tokenize-0.1.2.tar.gz.

File metadata

  • Download URL: ft_tokenize-0.1.2.tar.gz
  • Upload date:
  • Size: 13.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for ft_tokenize-0.1.2.tar.gz
Algorithm Hash digest
SHA256 2c2717150ec43f78a2e6f82720d1d1e3877abe9d874d3db2c2b08f7a35311e30
MD5 583c4a470a4685b7da88ed2cbbab0763
BLAKE2b-256 cac7457b4b50baa7ab58340725871699f79d4c5dacf7160f29ec4ba8feaaa8c4

See more details on using hashes here.

File details

Details for the file ft_tokenize-0.1.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for ft_tokenize-0.1.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 0453ff4f1b63edbf7a2fff9118f009316dc24e842dc008699b27ccd54777f394
MD5 a285c4f278be32fa2a8b24100d78f0cb
BLAKE2b-256 2212a11b3b816baa0ed99fbe29fbcd55c69b4d4ecd7e9e99c44419b69e831206

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page