Pre-release

This release is a pre-release and may not be stable for production use.

nxrt-ep-cpu

A pip-installable ONNX Runtime plugin execution provider (CPU). The wheel bundles the compiled onnx-runtime-ep-cpu-plugin shared library (libonnx_runtime_ep_cpu_plugin.{so,dll,dylib}) and exposes the absolute path to it so ONNX Runtime can load it via RegisterExecutionProviderLibrary(registration_name, library_path).

The bundled library exports the ORT plugin-EP C ABI (CreateEpFactories / ReleaseEpFactory). It is not a Python extension — it is a plain C-ABI shared library that ONNX Runtime dlopens.

Install

pip install nxrt-ep-cpu

Usage

import nxrt_ep_cpu

# Absolute path to the bundled cdylib (guaranteed to exist).
path = nxrt_ep_cpu.get_library_path()

# Register with ONNX Runtime (requires `onnxruntime` to be installed).
import onnxruntime as ort
so = ort.SessionOptions()
nxrt_ep_cpu.register(so)          # thin wrapper over register_execution_provider_library
# ...or register manually with the path from get_library_path().

register() prefers SessionOptions.register_execution_provider_library when a SessionOptions is passed, and falls back to the module-level onnxruntime.register_execution_provider_library. If onnxruntime is not installed it raises a clear ImportError.

Platforms

Linux (x86_64, manylinux), Windows (AMD64) and macOS (arm64). The wheel is platform-specific — it contains a compiled shared library and is not pure-Python.

License

MIT. See the onnx-genai repository.

Project links

Data verified by PyPI on Aug 12, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for justinchuby from gravatar.com justinchuby

Credits

Author: Justin Chu

GitHub Statistics

Data verified by PyPI on Aug 12, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License

MIT License (MIT)

Requires

Python >=3.8

Provides Extra

onnxruntime

Tags

onnx onnxruntime execution-provider cpu plugin

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

nxrt_ep_cpu-0.1.0.dev5-py3-none-win_amd64.whl (1.5 MB view details)

Uploaded Python 3Windows x86-64

nxrt_ep_cpu-0.1.0.dev5-py3-none-manylinux_2_28_x86_64.whl (1.8 MB view details)

Uploaded Python 3manylinux: glibc 2.28+ x86-64

nxrt_ep_cpu-0.1.0.dev5-py3-none-macosx_11_0_arm64.whl (1.6 MB view details)

Uploaded Python 3macOS 11.0+ ARM64

File details

Details for the file nxrt_ep_cpu-0.1.0.dev5-py3-none-win_amd64.whl.

File metadata

File hashes

Hashes for nxrt_ep_cpu-0.1.0.dev5-py3-none-win_amd64.whl
Algorithm Hash digest
SHA256 57e1d0059fcc94936fd38185537b813b53e11d207b0937438985a77ac2eeacad
MD5 131346eea0c447fec7baf50b9432b308
BLAKE2b-256 fe42501bb0da900c7b919a15534fda7d49cb20937847a53d17bcd54fff9f52e3

See more details on using hashes here.

Provenance

The following attestation bundles were made for nxrt_ep_cpu-0.1.0.dev5-py3-none-win_amd64.whl:

Publisher: publish-ep-plugins.yml on justinchuby/onnx-genai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nxrt_ep_cpu-0.1.0.dev5-py3-none-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for nxrt_ep_cpu-0.1.0.dev5-py3-none-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 bd8b57079151dbc3e84f3108c235a75b334a19ee1e248b31a345932c8f203175
MD5 f88f774f19643d7183ad6a6c918adb3e
BLAKE2b-256 d894622f6c8ac72976384ec8a779a2b816bd36b12fa6866b22af74f547d89122

See more details on using hashes here.

Provenance

The following attestation bundles were made for nxrt_ep_cpu-0.1.0.dev5-py3-none-manylinux_2_28_x86_64.whl:

Publisher: publish-ep-plugins.yml on justinchuby/onnx-genai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nxrt_ep_cpu-0.1.0.dev5-py3-none-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for nxrt_ep_cpu-0.1.0.dev5-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 c508751f1ca48b22f6c0e78e1e236c1c302f311b7a696aa9cf736590ea6eb08c
MD5 3708b6048c97a2e195ae627413a6f9dd
BLAKE2b-256 98fead65dc1cf5d3e009f297a903dd8d351ea674094fac893d7cea07409eabfb

See more details on using hashes here.

Provenance

The following attestation bundles were made for nxrt_ep_cpu-0.1.0.dev5-py3-none-macosx_11_0_arm64.whl:

Publisher: publish-ep-plugins.yml on justinchuby/onnx-genai

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release
Pre-release

0.1.0.dev5 This release

3 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page