Skip to main content

Accelerate PyTorch models with ONNX Runtime

Project description

The torch-ort packages uses the PyTorch APIs to accelerate PyTorch models using ONNX Runtime.


The torch-ort package depends on the onnxruntime-training package, which depends on specific versions of GPU libraries such as NVIDIA CUDA.

The default command pip install torch-ort installs the onnxruntime-training version that depends on CUDA 10.2.

If you have a different version of CUDA installed, you can install a different version of onnxruntime-training explicitly:

  • CUDA 11.1 pip install onnxruntime-training -f

Post-installation step

Once torch-ort is installed, there is a post-installation step:

python -m torch_ort.configure

If this step fails, it is likely due to GPU library version mismatch between onnxruntime-training and your installation. You can check the version of onnxruntime-training by running pip list. For example:

onnxruntime-training 1.9.0+cu111


Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release. See tutorial on generating distribution archives.

Built Distribution

torch_ort-1.16.0-py3-none-any.whl (5.8 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page