Skip to main content

mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit level (cuda128, cuda129, cuda131) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Metadata

Release files for mistralrs 0.8.20

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.8.20
File Actions
mistralrs-0.8.20-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details for mistralrs-0.8.20-cp310-abi3-win_amd64.whl
mistralrs-0.8.20-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details for mistralrs-0.8.20-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
mistralrs-0.8.20-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details for mistralrs-0.8.20-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
mistralrs-0.8.20-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details for mistralrs-0.8.20-cp310-abi3-macosx_11_0_arm64.whl

Total release size: 101.1 MB

Release files / mistralrs-0.8.20-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.8.20-cp310-abi3-win_amd64.whl
Size 20.0 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
1e1becb4bba219a16a4e82cff032ea537d6736fb6b3a9ed48d23f0cfe05a7658
BLAKE2b-256 checksum
How to use checksums
9937498e5fa78c06959eb9ea6e84df96ef111b94a66ef02245f54658eb8e2c49
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 21, 2026.

Transparency log

Release files / mistralrs-0.8.20-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.8.20-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 22.7 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
04a855da0982a17a2e265d0f5ee91cf1a1b80c251f3a7886db33b6b1e854ed22
BLAKE2b-256 checksum
How to use checksums
6268fb12c179f606ce1fd7a29f45397c520339523118ccfeb7ffaa617c8f9f13
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 21, 2026.

Transparency log

Release files / mistralrs-0.8.20-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.8.20-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 22.1 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
4b69757f860ee209a4656814a798f2c5c0306a846f41a48ff43fef1275bf209b
BLAKE2b-256 checksum
How to use checksums
ac49198c4bb240c624ae4c049d6d5595badf8738d5a223db9021219c44515fb4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 21, 2026.

Transparency log

Release files / mistralrs-0.8.20-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.8.20-cp310-abi3-macosx_11_0_arm64.whl
Size 36.3 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
96eb06d37a611e4096ef5421fa8298f41138319fa39d4d4bda55c4343f07c183
BLAKE2b-256 checksum
How to use checksums
06406e65781ce57a43bc731b7758ab00d6a5dd2081cc98d882c39f1318f367c7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 21, 2026.

Transparency log

Security for mistralrs 0.8.20

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 4 files in this release have been uploaded with provenance metadata.

Select from 4 files

Attestation for mistralrs-0.8.20-cp310-abi3-win_amd64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Jun 21, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.8.20 This release

4 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page