Skip to main content

onnxruntime-ep-mlx

PyPI Version Rust crate

MLX-native ONNX Runtime execution provider for Apple Silicon. It is an out-of-tree plugin EP for ONNX Runtime 1.31 or newer and requires no ONNX Runtime fork.

The wheel bundles MLX 0.32.2 commit 1f8e74e3 and mlx-c commit c74db530. It supports encoder, LLM prefill, and token-at-a-time decode workloads, including quantized matmul, attention, normalization, convolution, shape operations, and compiled shape-specialized If, Loop, and Scan control flow.

See the complete README for operator coverage, performance results, diagnostics, build instructions, and C/C++ integration.

Install

pip install -U onnxruntime-ep-mlx
import onnxruntime as ort
import onnxruntime_ep_mlx

onnxruntime_ep_mlx.register_execution_provider_library()
session = ort.InferenceSession(
    "model.onnx",
    providers=["MLXExecutionProvider", "CPUExecutionProvider"],
)
outputs = session.run(None, feeds)

The package requires macOS 14+ on Apple Silicon, Python 3.11+, and ONNX Runtime 1.31 or newer. The 0.31.x package series targets ABI 31 and is built with ONNX Runtime 1.31 headers.

Metadata

Release files for onnxruntime-ep-mlx 0.31.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for onnxruntime-ep-mlx 0.31.0
File Size Uploaded Provenance
onnxruntime_ep_mlx-0.31.0.tar.gz 313.4 kB With provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for onnxruntime-ep-mlx 0.31.0
File Interpreter ABI Platform
onnxruntime_ep_mlx-0.31.0-py3-none-macosx_14_0_arm64.whl Python 3 none macOS 14.0+ ARM64 Details

Total release size: 43.5 MB

Release files / onnxruntime_ep_mlx-0.31.0.tar.gz

Download URL onnxruntime_ep_mlx-0.31.0.tar.gz
Size 313.4 kB
Tags Source
SHA-256 checksum
How to use checksums
b27d943c705a7776f8254ed653dc0546a5cf08a807c56c644cf9577451f63b3b
BLAKE2b-256 checksum
How to use checksums
a897dcdf501cca3ad69c22078efc6bb5ed402878d4937e797255d594723bdc56
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

Release files / onnxruntime_ep_mlx-0.31.0-py3-none-macosx_14_0_arm64.whl

Download URL onnxruntime_ep_mlx-0.31.0-py3-none-macosx_14_0_arm64.whl
Size 43.2 MB
Tags Python 3 macOS 14.0+ ARM64
SHA-256 checksum
How to use checksums
507070f9def0093c8ff083037fc4538017248effb958e150f471cbe5ac05d5d1
BLAKE2b-256 checksum
How to use checksums
29e8115e78b7cfb39cb3c2a938c85a5cc60a9f716fd94530612df35ccff6d26a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

Security for onnxruntime-ep-mlx 0.31.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for onnxruntime_ep_mlx-0.31.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 22, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page