Skip to main content

Accelerate PyTorch models with ONNX Runtime

Project description

The torch-ort packages uses the PyTorch APIs to accelerate PyTorch models using ONNX Runtime.

Dependencies

The torch-ort package depends on the onnxruntime-training package, which depends on specific versions of GPU libraries such as NVIDIA CUDA.

The default command pip install torch-ort installs the onnxruntime-training version that depends on CUDA 10.2.

If you have a different version of CUDA installed, you can install a different version of onnxruntime-training explicitly:

  • CUDA 11.1 pip install onnxruntime-training -f https://download.onnxruntime.ai/onnxruntime_stable_cu111.html

Post-installation step

Once torch-ort is installed, there is a post-installation step:

python -m torch_ort.configure

If this step fails, it is likely due to GPU library version mismatch between onnxruntime-training and your installation. You can check the version of onnxruntime-training by running pip list. For example:

onnxruntime-training 1.9.0+cu111

Releases

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Built Distribution

torch_ort-1.12.0-py3-none-any.whl (5.8 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page