A fast C++ BPE tokenizer with Python bindings

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for sly-sloth from gravatar.com sly-sloth

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT
  • Author: Vaibhav Sharma
  • Requires: Python >=3.7
Report project as malware

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for sly-sloth from gravatar.com sly-sloth

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT
  • Author: Vaibhav Sharma
  • Requires: Python >=3.7

Release history Release notifications | RSS feed

0.1.6

0.1.5

0.1.4

This version

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bytoken-0.1.0.tar.gz (3.9 kB view details)

Uploaded Source

File details

Details for the file bytoken-0.1.0.tar.gz.

File metadata

  • Download URL: bytoken-0.1.0.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.5

File hashes

Hashes for bytoken-0.1.0.tar.gz
Algorithm Hash digest
SHA256 f2ebd232ea672bd7d05ad34edbc7924add622f5d843ba4c8f0c295bd3d1caba3
MD5 d9b3789d205afbc5841d76840484906f
BLAKE2b-256 a88b7ddab255f702062c0c95fb1c2ab300ede79a3b602e91d9fdf63e60e81f3d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page