Skip to main content

Tokenizers for NLP tasks.

Project description

naive-tokenizers

Tokenizers for NLP tasks.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

naive-tokenizers-0.0.1.tar.gz (8.2 kB view details)

Uploaded Source

Built Distribution

naive_tokenizers-0.0.1-py3-none-any.whl (14.7 kB view details)

Uploaded Python 3

File details

Details for the file naive-tokenizers-0.0.1.tar.gz.

File metadata

  • Download URL: naive-tokenizers-0.0.1.tar.gz
  • Upload date:
  • Size: 8.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5

File hashes

Hashes for naive-tokenizers-0.0.1.tar.gz
Algorithm Hash digest
SHA256 fb075eeaebe4b53d9584fe89ce226ad685b0dbe9b7a8bf7084f3b02bd10e8104
MD5 1dd13a417d66c10513e5c7cee3fa38b6
BLAKE2b-256 9db937f7855d555f3c730c80d6e6151ae7ef36230b3ed63c84596dee0482668c

See more details on using hashes here.

File details

Details for the file naive_tokenizers-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: naive_tokenizers-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 14.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/47.1.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.5

File hashes

Hashes for naive_tokenizers-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4189bf554867ff8249114b3ee87cbec72be90c8e7aed1209a77acc178a087ac1
MD5 456bb9fe1fa10d3246678a6d18ba7e85
BLAKE2b-256 aa960fbd1bafab612eacb21dd46a6799906897222eadf90d523be257504aa4c3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page