Accelerate PyTorch models with ONNX Runtime
Project description
The torch-ort packages uses the PyTorch APIs to accelerate PyTorch models using ONNX Runtime.
Dependencies
The torch-ort package depends on the onnxruntime-training package, which depends on specific versions of GPU libraries such as NVIDIA CUDA.
The default command pip install torch-ort
installs the onnxruntime-training version that depends on CUDA 10.2.
If you have a different version of CUDA installed, you can install a different version of onnxruntime-training explicitly:
- CUDA 11.1
pip install onnxruntime-training -f https://download.onnxruntime.ai/onnxruntime_stable_cu111.html
Post-installation step
Once torch-ort is installed, there is a post-installation step:
python -m torch_ort.configure
If this step fails, it is likely due to GPU library version mismatch between onnxruntime-training and your installation. You can check the version of onnxruntime-training by running pip list
. For example:
onnxruntime-training 1.9.0+cu111
Releases
-
1.9.0
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.9.0
-
1.8.1
Release Notes : https://github.com/pytorch/ort/releases/tag/v1.8.1
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for torch_ort-1.13.0.dev20221022-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa36bb3fef313799fdb5d80cb24fdd1cbffc588fd2a4d8670df4e6d558a4cd12 |
|
MD5 | 7a874e1ba246e5624a57b96cee6770a5 |
|
BLAKE2b-256 | 2e14c15b4b2007c95b81842507967d8f67fdf9519d7e1c032d518bcc4d70db38 |