"Furiosa LLM
Project description
furiosa_llm
This is an implementation of a high-throughput inference engine for LLMs using FuriosaAI NPUs. To learn how to build, run and tests, please refer to the furiosa-runtime/README.md.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file furiosa_llm-2024.1.1-py3-none-any.whl
.
File metadata
- Download URL: furiosa_llm-2024.1.1-py3-none-any.whl
- Upload date:
- Size: 193.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93909750348926ae21601c548fa84ca17607aafd1a67e1b8a60da7739d181914 |
|
MD5 | cedbccdcaeaf5c46c9ce06f728a94753 |
|
BLAKE2b-256 | 4aaba87612f49f7603fc55a499ad4334a0756c626eb56fba4ee7fc74da69fa84 |