A Quick Library with Llama 3.1 & 3.2 Tokenization

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jeffxtang from gravatar.com jeffxtang

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License (MIT)
  • Author: Jeff Tang
  • Tags llama 3, tokenization, tokens, llama-tokens
  • Requires: Python >=3.10
Classifiers

Project description

llama-tokens

A Quick Library with Llama 3.1 & 3.2 Tokenization

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jeffxtang from gravatar.com jeffxtang

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License (MIT)
  • Author: Jeff Tang
  • Tags llama 3, tokenization, tokens, llama-tokens
  • Requires: Python >=3.10
Classifiers

Release history Release notifications | RSS feed

0.0.3

0.0.2

This version

0.0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_tokens-0.0.1.tar.gz (3.0 kB view details)

Uploaded Source

Built Distribution

llama_tokens-0.0.1-py3-none-any.whl (3.3 kB view details)

Uploaded Python 3

File details

Details for the file llama_tokens-0.0.1.tar.gz.

File metadata

  • Download URL: llama_tokens-0.0.1.tar.gz
  • Upload date:
  • Size: 3.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.15

File hashes

Hashes for llama_tokens-0.0.1.tar.gz
Algorithm Hash digest
SHA256 7ff5df8823dfc3e3365d4f74fa885ddd832c43aad02239c864292d20ad3646d4
MD5 c72ffc8a7a556219d996f0a78a74f135
BLAKE2b-256 dd330bf3eb8584862c7580998c9f72928dc034e020230b8a049d0fe9f686c91e

See more details on using hashes here.

File details

Details for the file llama_tokens-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for llama_tokens-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 cd4119f6b5d5338b8bcf67a755b2efa7fd2d0d26540fd0b12d8aa9f29a183767
MD5 9af2d242c1741b91a5f6fef0e210023b
BLAKE2b-256 cfa0cab705a8c73f2475ef5bb1366c2b38418f19f05d34ba3e2a1c97d42790b9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page