mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit lane (cuda128, cuda129, cuda130, cuda131, cuda132, cuda133) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Project links

Data verified by PyPI on Sep 8, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.9.4)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for EricLBuehler from gravatar.com EricLBuehler

Credits

Author: Eric Buehler

GitHub Statistics

Data verified by PyPI on Sep 8, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License (MIT)

Requires

Python >=3.10

Tags

llm inference machine-learning ai transformers

Classifiers

Report project as malware

Release files for mistralrs 0.9.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.9.3
File
mistralrs-0.9.3-cp310-abi3-win_amd64.whl 22.9 MB CPython 3.10 abi3 Windows x86-64 Details
mistralrs-0.9.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 25.5 MB CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details
mistralrs-0.9.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 25.6 MB CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details
mistralrs-0.9.3-cp310-abi3-macosx_11_0_arm64.whl 38.4 MB CPython 3.10 abi3 macOS 11.0+ ARM64 Details

Total release size: 112.4 MB

Release files / mistralrs-0.9.3-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.9.3-cp310-abi3-win_amd64.whl
Size 22.9 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums 		36c7fcfadb71d70ad40945a59935ccdb0c732e16272a054d050c3373ef7ab8c1
BLAKE2b-256 checksum
How to use checksums 		4605848dde1bdc5c0bf06e81bea78da4e2c577480151eb70410b63b972d5ba2b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/24dbf5c256f232176ee5949485ba264049407fbe
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/24dbf5c256f232176ee5949485ba264049407fbe/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/34167795715/attempts/1
Artifact
Subject
mistralrs-0.9.3-cp310-abi3-win_amd64.whl
SHA-256 checksum
36c7fcfadb71d70ad40945a59935ccdb0c732e16272a054d050c3373ef7ab8c1 Verifying attestations

Release files / mistralrs-0.9.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.9.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 25.5 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums 		764858ddc53d6a80be3d94bca83447db6c7dee8772491c568e67500f430817d9
BLAKE2b-256 checksum
How to use checksums 		c38ba70abb2dad0b1b1fee3db7df1fd41a1a2ea2a20615177f78fbfea4249c17
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/24dbf5c256f232176ee5949485ba264049407fbe
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/24dbf5c256f232176ee5949485ba264049407fbe/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/34167795715/attempts/1
Artifact
Subject
mistralrs-0.9.3-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
SHA-256 checksum
764858ddc53d6a80be3d94bca83447db6c7dee8772491c568e67500f430817d9 Verifying attestations

Release files / mistralrs-0.9.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.9.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 25.6 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums 		5c4e9400c98e1be9d26edd6b945b979fa0d3f403568f883640ee950db6bfd6db
BLAKE2b-256 checksum
How to use checksums 		96bf6749fe966c3218a00583fff684edb8ad3c2e2fa77b2c2c3513113c49ca5a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/24dbf5c256f232176ee5949485ba264049407fbe
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/24dbf5c256f232176ee5949485ba264049407fbe/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/34167795715/attempts/1
Artifact
Subject
mistralrs-0.9.3-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
SHA-256 checksum
5c4e9400c98e1be9d26edd6b945b979fa0d3f403568f883640ee950db6bfd6db Verifying attestations

Release files / mistralrs-0.9.3-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.9.3-cp310-abi3-macosx_11_0_arm64.whl
Size 38.4 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		9d28ea065830756f06aadf5737ad6ef1e1237284789944f61721579578c536ba
BLAKE2b-256 checksum
How to use checksums 		5e2517a7ef696c32327ad48ed82cf912dfd516bea70d4c9006d034cf4a3bf63c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 8, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/24dbf5c256f232176ee5949485ba264049407fbe
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/24dbf5c256f232176ee5949485ba264049407fbe/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/34167795715/attempts/1
Artifact
Subject
mistralrs-0.9.3-cp310-abi3-macosx_11_0_arm64.whl
SHA-256 checksum
9d28ea065830756f06aadf5737ad6ef1e1237284789944f61721579578c536ba Verifying attestations

Release history Release notifications | RSS feed

0.9.4

4 release files

This release

0.9.3 This release

4 release files

0.9.2

4 release files

0.9.1

4 release files

0.9.0

4 release files

0.8.23

4 release files

0.8.22

4 release files

0.8.21

4 release files

0.8.20

4 release files

0.8.18

4 release files

0.8.17

4 release files

0.8.16

4 release files

0.8.15

4 release files

0.8.14

4 release files

0.8.13

4 release files

0.8.12

4 release files

0.8.9

4 release files

0.8.8

4 release files

0.8.6

4 release files

0.8.5

4 release files

0.8.4

4 release files

0.8.0

4 release files

0.7.0

4 release files

0.6.0

15 release files

0.5.0

15 release files

0.4.0

12 release files

0.3.4

12 release files

0.3.3

8 release files

0.3.2

9 release files

0.3.1

1 release file

0.3.0

1 release file

0.2.5

1 release file

0.2.4

1 release file

0.2.3

1 release file

0.2.2

1 release file

0.2.1

1 release file

0.2.0

1 release file

0.1.24

1 release file

0.1.23

1 release file

0.1.22

1 release file

0.1.21

1 release file

0.1.20

1 release file

0.1.19

1 release file

0.1.18

1 release file

0.1.17

1 release file

0.1.16

1 release file

0.1.15

1 release file

0.1.14

1 release file

0.1.13

1 release file

0.1.12

1 release file

0.1.11

1 release file

0.1.10

1 release file

0.1.8

1 release file

0.1.7

1 release file

0.1.5

1 release file

0.1.4

1 release file

0.1.3

1 release file

0.1.2

1 release file

0.1.1

1 release file

0.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page