Skip to main content

A high-performance, light-weight llm inference framework.

Project description

# BlazeInfer A high-performance, light-weight llm inference framework.


About

Features

  • Optimized Attention Kernels

Getting Started

Acknowledgement

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

blazeinfer-0.0.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

blazeinfer-0.0.0-py3-none-any.whl (5.0 kB view details)

Uploaded Python 3

File details

Details for the file blazeinfer-0.0.0.tar.gz.

File metadata

  • Download URL: blazeinfer-0.0.0.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for blazeinfer-0.0.0.tar.gz
Algorithm Hash digest
SHA256 e87a187260b4089e236050f1ed0e1a5197e3119a755a83b77a297cf8bf4fa040
MD5 c3618fa8ae10653ff0d17f39cb3fd59b
BLAKE2b-256 e53ea0520e17bd03df438c75f344b9163fbdd21f3941ecc82726365e82707f90

See more details on using hashes here.

File details

Details for the file blazeinfer-0.0.0-py3-none-any.whl.

File metadata

  • Download URL: blazeinfer-0.0.0-py3-none-any.whl
  • Upload date:
  • Size: 5.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.11

File hashes

Hashes for blazeinfer-0.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 287ce90893af8a06fa1af6fe1d4482f8cce4b248370be70384698f7b903aaa6a
MD5 8fd872cf249cbc7f2b4ca17cbc33e08e
BLAKE2b-256 f7cfb8256758fb8413fb3f10fa069603b3ffa58ee730fb657c60cb0371d3fed9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page