mistralrs Python SDK
mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.
Documentation
For full documentation, see:
Quick Install
pip install mistralrs-cuda # NVIDIA GPUs
pip install mistralrs-metal # Apple Silicon
pip install mistralrs # CPU only
1 maintainer
Release files for mistralrs-metal 0.8.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| mistralrs_metal-0.8.0-cp310-abi3-macosx_15_0_arm64.whl | CPython 3.10 | abi3 | macOS 15.0+ ARM64 | Details |
Release files / mistralrs_metal-0.8.0-cp310-abi3-macosx_15_0_arm64.whl
| Download URL | mistralrs_metal-0.8.0-cp310-abi3-macosx_15_0_arm64.whl |
|---|---|
| Size | 27.0 MB |
| Tags | CPython 3.10 abi3 macOS 15.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
1b29a2ec842ddaf66b277b0f53c72e6cc07e168699d26afcf6f933a44a2dac85
|
|
BLAKE2b-256 checksum How to use checksums |
e9ee1b2366a0035ea191d17658d68119e8f4366a8b07bb96adfb76dbf30983ce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.7
|
