Skip to main content

"Furiosa LLM

Project description

furiosa_llm

This is an implementation of a high-throughput inference engine for LLMs using FuriosaAI NPUs. To learn how to build, run and tests, please refer to the furiosa-runtime/README.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

furiosa_llm-2024.2.1-py3-none-any.whl (231.5 kB view details)

Uploaded Python 3

File details

Details for the file furiosa_llm-2024.2.1-py3-none-any.whl.

File metadata

  • Download URL: furiosa_llm-2024.2.1-py3-none-any.whl
  • Upload date:
  • Size: 231.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.8.5

File hashes

Hashes for furiosa_llm-2024.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 759f513a68121bbbd06ee672f255b68abdcfb941814edb7eb3f4dc5da6774e48
MD5 e43170377aef3520d5829c0dcacf18c5
BLAKE2b-256 b84a09ef7ac0ce5e5b485c81d803b685e621aeb6279f9cf22a9d6b0e210de287

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page