mistralrs Python SDK

mistralrs is the Python SDK for mistral.rs, a blazing-fast LLM inference engine.

Documentation

For full documentation, see:

Quick Install

pip install mistralrs        # CPU, or Metal on Apple Silicon

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit lane (cuda128, cuda129, cuda130, cuda131, cuda132, cuda133) and GPU compute capability. See the Python SDK installation guide for the --find-links command.

Project links

Data verified by PyPI on Sep 24, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for EricLBuehler from gravatar.com EricLBuehler

Credits

Author: Eric Buehler

GitHub Statistics

Data verified by PyPI on Sep 24, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License (MIT)

Requires

Python >=3.10

Tags

llm inference machine-learning ai transformers

Classifiers

Report project as malware

Release files for mistralrs 0.9.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for mistralrs 0.9.4
File
mistralrs-0.9.4-cp310-abi3-win_amd64.whl 22.7 MB CPython 3.10 abi3 Windows x86-64 Details
mistralrs-0.9.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 25.5 MB CPython 3.10 abi3 Linux glibc 2.17+ x86-64 Details
mistralrs-0.9.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 25.5 MB CPython 3.10 abi3 Linux glibc 2.17+ ARM64 Details
mistralrs-0.9.4-cp310-abi3-macosx_11_0_arm64.whl 38.4 MB CPython 3.10 abi3 macOS 11.0+ ARM64 Details

Total release size: 112.2 MB

Release files / mistralrs-0.9.4-cp310-abi3-win_amd64.whl

Download URL mistralrs-0.9.4-cp310-abi3-win_amd64.whl
Size 22.7 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums 		4102b4ddabc979818556a596e08d3e5a9741e6a939a7ebad2a230f76681338d6
BLAKE2b-256 checksum
How to use checksums 		bbe27ecc3665f322364c5aa91c6cab2a08e04eb17514b6ada8326321b9edb223
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 24, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/4400935451da5e2dc7379a3f92fbbada66557f6c
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/4400935451da5e2dc7379a3f92fbbada66557f6c/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/36039265944/attempts/1
Artifact
Subject
mistralrs-0.9.4-cp310-abi3-win_amd64.whl
SHA-256 checksum
4102b4ddabc979818556a596e08d3e5a9741e6a939a7ebad2a230f76681338d6 Verifying attestations

Release files / mistralrs-0.9.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL mistralrs-0.9.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 25.5 MB
Tags CPython 3.10 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums 		14169aa3d43c1ea5c702883d29cc8d699dfb67a78ea2e4e06518389c2add2107
BLAKE2b-256 checksum
How to use checksums 		0f0e8dc926ee849d86ca3f84acdfb5fea21427c2504af430916b5cad71f94d42
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 24, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/4400935451da5e2dc7379a3f92fbbada66557f6c
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/4400935451da5e2dc7379a3f92fbbada66557f6c/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/36039265944/attempts/1
Artifact
Subject
mistralrs-0.9.4-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
SHA-256 checksum
14169aa3d43c1ea5c702883d29cc8d699dfb67a78ea2e4e06518389c2add2107 Verifying attestations

Release files / mistralrs-0.9.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL mistralrs-0.9.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 25.5 MB
Tags CPython 3.10 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums 		c2473afc6e482083b658a9b41470bb821aa7dd73a331e321bb973aa79b46b34f
BLAKE2b-256 checksum
How to use checksums 		298ca24b06e31787e5a7cefa8ddb00a9ba15372d20520bf0ba220e50e11b6253
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 24, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/4400935451da5e2dc7379a3f92fbbada66557f6c
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/4400935451da5e2dc7379a3f92fbbada66557f6c/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/36039265944/attempts/1
Artifact
Subject
mistralrs-0.9.4-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
SHA-256 checksum
c2473afc6e482083b658a9b41470bb821aa7dd73a331e321bb973aa79b46b34f Verifying attestations

Release files / mistralrs-0.9.4-cp310-abi3-macosx_11_0_arm64.whl

Download URL mistralrs-0.9.4-cp310-abi3-macosx_11_0_arm64.whl
Size 38.4 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums 		5f6c0348bc7341b25123f86dbcb4c6ffa51064a04a01f5e4e015ddc1f023347a
BLAKE2b-256 checksum
How to use checksums 		1603d41ecb55c997bea22294ce8c3a7eba11dd1969130766ed37d608b6b1f099
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing? 		Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 24, 2026.

Transparency log
Identity
Publishing platform
GitHub Actions
Publishing repository
github.com/EricLBuehler/mistral.rs
Publishing commit
github.com/EricLBuehler/mistral.rs/tree/4400935451da5e2dc7379a3f92fbbada66557f6c
Workflow
Publishing configuration
github.com/EricLBuehler/mistral.rs/blob/4400935451da5e2dc7379a3f92fbbada66557f6c/.github/workflows/release.yml
Publishing logs
github.com/EricLBuehler/mistral.rs/actions/runs/36039265944/attempts/1
Artifact
Subject
mistralrs-0.9.4-cp310-abi3-macosx_11_0_arm64.whl
SHA-256 checksum
5f6c0348bc7341b25123f86dbcb4c6ffa51064a04a01f5e4e015ddc1f023347a Verifying attestations

Release history Release notifications | RSS feed

This release

0.9.4 This release

4 release files

0.9.3

4 release files

0.9.2

4 release files

0.9.1

4 release files

0.9.0

4 release files

0.8.23

4 release files

0.8.22

4 release files

0.8.21

4 release files

0.8.20

4 release files

0.8.18

4 release files

0.8.17

4 release files

0.8.16

4 release files

0.8.15

4 release files

0.8.14

4 release files

0.8.13

4 release files

0.8.12

4 release files

0.8.9

4 release files

0.8.8

4 release files

0.8.6

4 release files

0.8.5

4 release files

0.8.4

4 release files

0.8.0

4 release files

0.7.0

4 release files

0.6.0

15 release files

0.5.0

15 release files

0.4.0

12 release files

0.3.4

12 release files

0.3.3

8 release files

0.3.2

9 release files

0.3.1

1 release file

0.3.0

1 release file

0.2.5

1 release file

0.2.4

1 release file

0.2.3

1 release file

0.2.2

1 release file

0.2.1

1 release file

0.2.0

1 release file

0.1.24

1 release file

0.1.23

1 release file

0.1.22

1 release file

0.1.21

1 release file

0.1.20

1 release file

0.1.19

1 release file

0.1.18

1 release file

0.1.17

1 release file

0.1.16

1 release file

0.1.15

1 release file

0.1.14

1 release file

0.1.13

1 release file

0.1.12

1 release file

0.1.11

1 release file

0.1.10

1 release file

0.1.8

1 release file

0.1.7

1 release file

0.1.5

1 release file

0.1.4

1 release file

0.1.3

1 release file

0.1.2

1 release file

0.1.1

1 release file

0.1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page