OpenVINO™ Execution Provider Plugin for ONNX Runtime
This package provides the OpenVINO™ Execution Provider plugin for ONNX Runtime.
Installation
Prerequisites
-
ONNX Runtime: Install separately (this package does NOT include ONNX Runtime)
pip install onnxruntime>=1.23.0
-
Platform: Pre-built wheels available for:
- Windows x64
- Linux x86_64 (manylinux_2_28 compatible — glibc 2.28+, e.g. RHEL 8, Ubuntu 20.04+)
Install the Plugin
pip install onnxruntime-ep-openvino
Note: This package is distributed as binary wheels only. If no wheel is available for your platform/Python version, installation will fail. Source builds are not supported.
Usage
Basic Example
import onnxruntime as ort
import onnxruntime_ep_openvino as openvino_ep
# Get the plugin library path
ep_lib_path = openvino_ep.get_library_path()
# Register the plugin with ONNX Runtime
registration_name = "openvino_ep"
ort.register_execution_provider_library(registration_name, ep_lib_path)
# Get the EP name
ep_name = openvino_ep.get_ep_name()
# Get available OpenVINO devices
all_ep_devices = ort.get_ep_devices()
openvino_devices = [d for d in all_ep_devices if d.ep_name == ep_name]
if not openvino_devices:
raise RuntimeError("No OpenVINO devices found")
# Select OpenVINO CPU device
cpu_devices = [d for d in openvino_devices if d.ep_metadata.get("ov_device") == "CPU"]
if not cpu_devices:
raise RuntimeError("No OpenVINO CPU device found")
# Create session options
sess_options = ort.SessionOptions()
# Add OpenVINO EP to the session
ep_options = {}
sess_options.add_provider_for_devices([cpu_devices[0]], ep_options)
# Create inference session
model_path = "path/to/model.onnx"
session = ort.InferenceSession(model_path, sess_options=sess_options)
# Run inference
# ... your inference code here ...
# Clean up
del session
# Unregister the library after all sessions are closed
ort.unregister_execution_provider_library(registration_name)
Helper Functions
get_library_path()
Returns the full path to the OpenVINO EP plugin library.
import onnxruntime_ep_openvino as openvino_ep
lib_path = openvino_ep.get_library_path()
print(f"Plugin library: {lib_path}")
get_ep_name()
Returns the name of the Execution Provider: "OpenVINOExecutionProvider"
ep_name = openvino_ep.get_ep_name()
print(f"EP name: {ep_name}")
get_ep_names()
Returns a list containing the EP name (for compatibility with multi-EP plugins).
ep_names = openvino_ep.get_ep_names()
# Returns: ['OpenVINOExecutionProvider']
Troubleshooting
Library Not Found
If you get a FileNotFoundError, ensure:
- The package is properly installed:
pip list | grep onnxruntime-ep-openvino - Reinstall if needed:
pip install --force-reinstall onnxruntime-ep-openvino
Note: OpenVINO and TBB libraries are bundled with the package - no separate installation needed!
No Devices Found
If get_ep_devices() doesn't return OpenVINO devices:
- Check that the plugin is registered before calling
get_ep_devices() - Verify your hardware is supported by OpenVINO
- Restart your Python session after installation
Version Compatibility
- Requires ONNX Runtime 1.23.0 or later
License
This project is licensed under the MIT License
Copyright (C) Intel Corporation
Metadata
Release files for onnxruntime-ep-openvino 1.8.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| onnxruntime_ep_openvino-1.8.0-py3-none-win_amd64.whl | Python 3 | none | Windows x86-64 | Details for onnxruntime_ep_openvino-1.8.0-py3-none-win_amd64.whl |
| onnxruntime_ep_openvino-1.8.0-py3-none-manylinux_2_28_x86_64.whl | Python 3 | none | Linux glibc 2.28+ x86-64 | Details for onnxruntime_ep_openvino-1.8.0-py3-none-manylinux_2_28_x86_64.whl |
Total release size: 128.4 MB
Release files / onnxruntime_ep_openvino-1.8.0-py3-none-win_amd64.whl
| Download URL | onnxruntime_ep_openvino-1.8.0-py3-none-win_amd64.whl |
|---|---|
| Size | 75.8 MB |
| Tags | Python 3 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
42a213c39daccc8119b009373ad734740103eefa6f88d73fba4dc389458efb02
|
|
BLAKE2b-256 checksum How to use checksums |
8266d37ad05e45ed84d2a3cb3c6c4dafaa9702d4908e584042c519d1a870d40e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.8.13
|
Release files / onnxruntime_ep_openvino-1.8.0-py3-none-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_ep_openvino-1.8.0-py3-none-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 52.6 MB |
| Tags | Linux glibc 2.28+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
aaa9544cbfd5d52478967760bc981107850cc8f96ab280d9393ba28d249d802b
|
|
BLAKE2b-256 checksum How to use checksums |
75de1d07df4f71e3505d9ca725b173a746138d0939053fd0ddfed09b2173b5a1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.8.13
|
Security for onnxruntime-ep-openvino 1.8.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.