Accelerate PyTorch models with ONNX Runtime
Project description
The torch-ort packages uses the PyTorch APIs to accelerate PyTorch models using ONNX Runtime.
Dependencies
The torch-ort package depends on the onnxruntime-training package, which depends on specific versions of GPU libraries such as NVIDIA CUDA.
The default command pip install torch-ort
installs the onnxruntime-training version that depends on CUDA 10.2.
If you have a different version of CUDA installed, you can install a different version of onnxruntime-training explicitly:
- CUDA 11.1
pip install onnxruntime-training -f https://download.onnxruntime.ai/onnxruntime_stable_cu111.html
Post-installation step
Once torch-ort is installed, there is a post-installation step:
python -m torch_ort.configure
If this step fails, it is likely due to GPU library version mismatch between onnxruntime-training and your installation. You can check the version of onnxruntime-training by running pip list
. For example:
onnxruntime-training 1.9.0+cu111
Releases
-
1.9.0
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.9.0
-
1.8.1
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.8.1
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for torch_ort-1.16.0.dev20240206-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c8286ca0a72ccae348b2b15e369fbe32e8de8619a75c411558c411b1074ec820 |
|
MD5 | 0cb501702b3801022492fe256ecdbb17 |
|
BLAKE2b-256 | 4c967a38698bc9198171bb8315d10ccc305fecae973219a0e7a103187cdb2282 |