A fast C++ BPE tokenizer with Python bindings

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for sly-sloth from gravatar.com sly-sloth

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT
  • Author: Vaibhav Sharma
  • Requires: Python >=3.7
Report project as malware

Project description

The author of this package has not provided a project description

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for sly-sloth from gravatar.com sly-sloth

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT
  • Author: Vaibhav Sharma
  • Requires: Python >=3.7

Release history Release notifications | RSS feed

0.1.6

0.1.5

This version

0.1.4

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bytoken-0.1.4.tar.gz (5.2 kB view details)

Uploaded Source

File details

Details for the file bytoken-0.1.4.tar.gz.

File metadata

  • Download URL: bytoken-0.1.4.tar.gz
  • Upload date:
  • Size: 5.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.5

File hashes

Hashes for bytoken-0.1.4.tar.gz
Algorithm Hash digest
SHA256 1e4bdefe2280634bfb9bf39ac0e6852242f1b1a9d0abdc752a8bd9463cf454e7
MD5 deaae45faeaea9617ec704f70e94f243
BLAKE2b-256 901f98a90828a90c0b8adf7cad73c4cb60c57a10e72299fac8858aeba56a376a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page