Skip to main content

mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit lane (cuda128, cuda129, cuda130, cuda131, cuda132, cuda133) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Metadata

Release files for mistralrs 0.9.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.9.5
File Actions
mistralrs-0.9.5-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for mistralrs-0.9.5-cp310-abi3-win_amd64.whl
mistralrs-0.9.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details for mistralrs-0.9.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
mistralrs-0.9.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details for mistralrs-0.9.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
mistralrs-0.9.5-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for mistralrs-0.9.5-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 115.7 MB

Release files / mistralrs-0.9.5-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.9.5-cp310-abi3-win_amd64.whl
Size 23.2 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
bcc7817e3c775e1747254804b8e936869e9052fbfda29e37608dfd61c19409dd
BLAKE2b-256 checksum
How to use checksums
cfa3fb05f0becdc28cf902a2ca2a4bb46cec5ea6e10cb4d3086d10343a9a4e8e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Release files / mistralrs-0.9.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.9.5-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 26.0 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
60cd70976a2ec50175f3d68cd269ccfa75b488c521a34e1d631c1f3da384bd01
BLAKE2b-256 checksum
How to use checksums
03bc1540501c33478381eddcbaf3f49f592c098e8a864b26f25b21ec58ebb4aa
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Release files / mistralrs-0.9.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.9.5-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 26.1 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
0e66c659488a8b988b48b0986f88c15dcea6a2ea31b380bebba5e40beabbbcf7
BLAKE2b-256 checksum
How to use checksums
96739e6c1eeb0c53d259fc29b2e3afea21d6938f1ce0f762375fc0be4ec57635
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Release files / mistralrs-0.9.5-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.9.5-cp310-abi3-macosx_11_0_arm64.whl
Size 40.4 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
564f6f0204e074104510af4ab6c9391790d1a9f73cb8e0a65299736c13b3536c
BLAKE2b-256 checksum
How to use checksums
7c997ff50706ccb40ee8894204a43162769e640c4414d82237fc6620ea25947a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

Security for mistralrs 0.9.5

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 4 files in this release have been uploaded with provenance metadata.

Select from 4 files

Attestation for mistralrs-0.9.5-cp310-abi3-win_amd64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 19, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.9.5 This release

4 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page