Skip to main content

Speed-of-light TokenSpeed MLA kernels for Blackwell SM100 and SM103.

Project description

tokenspeed-mla

Speed-of-light TokenSpeed MLA kernels for Blackwell SM100 and SM103.

from tokenspeed_mla import (
    get_num_sm,
    mla_kv_pack_quantize_fp8,
    tokenspeed_mla_decode,
    tokenspeed_mla_prefill,
    warmup_compile_prefill,
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenspeed_mla-0.1.1.tar.gz (119.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tokenspeed_mla-0.1.1-py3-none-any.whl (129.6 kB view details)

Uploaded Python 3

File details

Details for the file tokenspeed_mla-0.1.1.tar.gz.

File metadata

  • Download URL: tokenspeed_mla-0.1.1.tar.gz
  • Upload date:
  • Size: 119.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenspeed_mla-0.1.1.tar.gz
Algorithm Hash digest
SHA256 df67032b47460860676fca3592f5637c2cf70baf708e32150022e23493dc6883
MD5 75ac808a57e7af97d7ceeef4af4603da
BLAKE2b-256 bf71659b972967ce37af1795b3bd83c6605d0dd3e1e49986bb227aca3925a82e

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenspeed_mla-0.1.1.tar.gz:

Publisher: release-tokenspeed-mla.yml on lightseekorg/tokenspeed

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tokenspeed_mla-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: tokenspeed_mla-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 129.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tokenspeed_mla-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9effe6f6a4b23c41c975e98f89849c371479ae667d582dcef077001d859f3429
MD5 7e2ff5fbb08b1e938dad2bfe6e4a8b1f
BLAKE2b-256 1241161bc80ecee3733cb16e7a95cbf77c36d1a713a582510abafa5822485be9

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenspeed_mla-0.1.1-py3-none-any.whl:

Publisher: release-tokenspeed-mla.yml on lightseekorg/tokenspeed

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page