Skip to main content

mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit level (cuda128, cuda129, cuda131) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Metadata

Release files for mistralrs 0.8.16

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.8.16
File Actions
mistralrs-0.8.16-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for mistralrs-0.8.16-cp310-abi3-win_amd64.whl
mistralrs-0.8.16-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details for mistralrs-0.8.16-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
mistralrs-0.8.16-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details for mistralrs-0.8.16-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
mistralrs-0.8.16-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for mistralrs-0.8.16-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 100.9 MB

Release files / mistralrs-0.8.16-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.8.16-cp310-abi3-win_amd64.whl
Size 20.0 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
bb70eebf17614bf8b37e37dc238d215a816b23c11a335f307fc1f441d41d0fa9
BLAKE2b-256 checksum
How to use checksums
a0e1e1c5256d74f1e0d69ea5d3e6273e10898d47135348960c30399ad9ca4914
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 20, 2026.

Transparency log

Release files / mistralrs-0.8.16-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.8.16-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 22.6 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
a63dd609f69baa4bc99e0308188ae1ce0d49995ea264f5049361429e3086ee14
BLAKE2b-256 checksum
How to use checksums
c0abdde8721ad7288760249dfcca33586e16f2dc8ca1c1ecccb3d3030d64b556
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 20, 2026.

Transparency log

Release files / mistralrs-0.8.16-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.8.16-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 22.0 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
ecfc9898bb5ac6810a14e26d5aa7d663b75a20521cc93d9f36377a32d61f3deb
BLAKE2b-256 checksum
How to use checksums
cd7ac2a84dbeca52f90cbc7e52ee750ce5e4ba5b7c839a5ab105dae75f766d28
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 20, 2026.

Transparency log

Release files / mistralrs-0.8.16-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.8.16-cp310-abi3-macosx_11_0_arm64.whl
Size 36.3 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
0a41c64674d009fea6798f43abca7205f22ee6b2ce3e25464d17357cbf4d039c
BLAKE2b-256 checksum
How to use checksums
fcd58784986c012e82068d2693475e313717b9123bc402f840af2ecb2ee81ada
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 20, 2026.

Transparency log

Security for mistralrs 0.8.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 4 files in this release have been uploaded with provenance metadata.

Select from 4 files

Attestation for mistralrs-0.8.16-cp310-abi3-win_amd64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 20, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.8.16 This release

4 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page