Skip to main content

mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit lane (cuda128, cuda129, cuda130, cuda131, cuda132, cuda133) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Metadata

Release files for mistralrs 0.9.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.9.2
File Actions
mistralrs-0.9.2-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for mistralrs-0.9.2-cp310-abi3-win_amd64.whl
mistralrs-0.9.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details for mistralrs-0.9.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
mistralrs-0.9.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details for mistralrs-0.9.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
mistralrs-0.9.2-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for mistralrs-0.9.2-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 110.4 MB

Release files / mistralrs-0.9.2-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.9.2-cp310-abi3-win_amd64.whl
Size 22.5 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
93255b66d2717a34883bad8611944c023b16e53a10bbe5514f86698a76065966
BLAKE2b-256 checksum
How to use checksums
bfe4b3e20ce114a123067c0d912c80a5fabe4bf27ee5b927f0eeb0359f348854
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 20, 2026.

Transparency log

Release files / mistralrs-0.9.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.9.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 25.0 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
1994ea7a55491bcddc536cc1068582eb18d6b19095cc1fa35ceb9ee879ed4bee
BLAKE2b-256 checksum
How to use checksums
3e24e1d9694e39186bb1f3839fbb56835836728cb10bf1590e99cd9da8b39983
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 20, 2026.

Transparency log

Release files / mistralrs-0.9.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.9.2-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 24.9 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
30ec65c64b6ced4f01f9a20df9eebc65f79a9910197c2a914149c4bb052ef927
BLAKE2b-256 checksum
How to use checksums
867fb89a4ea93923ab1b97f6584e4689e5285b27c5b02fb67d8c8cb76874ef0a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 20, 2026.

Transparency log

Release files / mistralrs-0.9.2-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.9.2-cp310-abi3-macosx_11_0_arm64.whl
Size 37.9 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
03d5665267896b3f9841fc78c1f248cbf097060790bed3dea8b7102f239b58df
BLAKE2b-256 checksum
How to use checksums
c682fee9f54be07be6f3af060124e4b322ee54ac9a44ec67ae4997315cb16fd6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 20, 2026.

Transparency log

Security for mistralrs 0.9.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 4 files in this release have been uploaded with provenance metadata.

Select from 4 files

Attestation for mistralrs-0.9.2-cp310-abi3-win_amd64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 20, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.9.2 This release

4 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page