ONNX Runtime GenAI
Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.
For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
Release files for onnxruntime-genai-cuda 0.17.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 129.5 MB
Release files / onnxruntime_genai_cuda-0.17.0-cp314-cp314-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp314-cp314-win_arm64.whl |
|---|---|
| Size | 6.2 MB |
| Tags | CPython 3.14 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
5f71e1620854754eeb9a70ab0c9cd2d987c6973312f3789fdef8965b21521475
|
|
BLAKE2b-256 checksum How to use checksums |
31eef49b6446ab35e780887fd5d5e7cf47cc24f1a8e31b71762b38dda87615d8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp314-cp314-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 8.7 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
460ed79bbdb0cf461494d322f3a9346524c215a0a354b763c8840635a281b8bc
|
|
BLAKE2b-256 checksum How to use checksums |
7a34a6ac22807987ced2fd4d62eb35a14f5f5db5eacc16c0c56cc5309e8882cd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
7b1678725fb22070041ca4e3a4ca468e7530504115007fd91f6325a0ccd236b3
|
|
BLAKE2b-256 checksum How to use checksums |
e97df96a50b3da63482b4241c6cc4767700e56a0d3d437b8a078ed6bd4b6be5a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp313-cp313-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp313-cp313-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.13 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
0250b4e85746582e5910ce5e02647603c13f5da8ac138c3be894bdb157916e50
|
|
BLAKE2b-256 checksum How to use checksums |
45ef14219ca74d93b0bd96a4a722f11693bc3f926299f918889dd1231cdd204b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp313-cp313-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
3dab4437621a537f3932013939355d5209a849522046838caacfcd16be088352
|
|
BLAKE2b-256 checksum How to use checksums |
f118d7f2f9cea505da0a0de3448f81f7b81bbb1c1274656f035d7c1f57d5476b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
db4ad158201cb70621f9f9456d376fc37dd41f4f01b8ca0d0aaede0d867291f1
|
|
BLAKE2b-256 checksum How to use checksums |
86acd6df1b288251aa838bb0c9310e162669450e4e2aa4dbcc8033e6d2701121
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp312-cp312-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp312-cp312-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.12 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
489bc6d3df30c1e2f4afcb64679afee5bc5d2d2ab582048f42947001e21fd593
|
|
BLAKE2b-256 checksum How to use checksums |
c778503b22db9685d2c6a869bc140803c66e741244ea1bed837d3d4051d5f875
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp312-cp312-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
7d3956625591829be8eb66b62038f9c316abadf18cf95f3c27c4e5858d8a4411
|
|
BLAKE2b-256 checksum How to use checksums |
976b2790780cfbb03c33c868eb840796be03958b2eb73206d14f9a316f658dc3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
eb7c4146205b4d5cee1e5b9be4a3d07c9acfb52247e1f8abd1f9d1eb98c833de
|
|
BLAKE2b-256 checksum How to use checksums |
df1e7ce246421d8438eb321254092a405601fdba7fb80e0740e3f2382f7848a1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp311-cp311-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp311-cp311-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.11 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
e198e0cd4f7e8e5aefe18324dccf5e6839d5e8293b978a4fa85c1e6ff2baa881
|
|
BLAKE2b-256 checksum How to use checksums |
e75a02a669610bb55057eb8b3d22403e5f6711cc191eb243fa9bd317763e4ccb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp311-cp311-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
8dff7729758e670e2d1921372d7414ff38c7d2f5087cf72a3259542b91e667b5
|
|
BLAKE2b-256 checksum How to use checksums |
7bb4fbbb753adb3d9fc5db1229c3e55d05658e987213fffb30c209f1bba551f9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.0-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.0-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
d1a8789244954d289d7e30a2c88cbc217be12d6d0541a9eda8693c15384ba1fe
|
|
BLAKE2b-256 checksum How to use checksums |
6d0e9839ad035fc829e1a8446e5b32437aecc1acfb5bb66d80da2e545bdc6d72
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
