ONNX Runtime GenAI
Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.
For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
Release files for onnxruntime-genai-cuda 0.18.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 193.7 MB
Release files / onnxruntime_genai_cuda-0.18.0-cp314-cp314-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp314-cp314-win_arm64.whl |
|---|---|
| Size | 6.4 MB |
| Tags | CPython 3.14 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
812ee5a09fd6dca7ea77923ef2ac5d619659ee8d4c05e960c8a54e4cd6f2bdf6
|
|
BLAKE2b-256 checksum How to use checksums |
4a252434f75be38499bdfc97006d7fcbc3e154f5de9d034e490ae334aecbc523
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp314-cp314-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 8.8 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
1951947e67a78f2e8c7511f0f9dbee3bde8fc42356530ca11cbb7b4b0421569a
|
|
BLAKE2b-256 checksum How to use checksums |
db72d7d9ef6767e07e4d96adde6d255f0cd383be9b2465a552682446426c0002
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp314-cp314-manylinux_2_34_aarch64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp314-cp314-manylinux_2_34_aarch64.whl |
|---|---|
| Size | 16.8 MB |
| Tags | CPython 3.14 Linux glibc 2.34+ ARM64 |
|
SHA-256 checksum How to use checksums |
413607ca006da17ef3599120a3926cf7845035584eb21a5c8cca21f5a8cedb65
|
|
BLAKE2b-256 checksum How to use checksums |
7c08e49d082e84ce882b8436f78f2a6f5be727ba5061e04ce95999e4fb0cc5bf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 16.7 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
54c692a6798ef073dcdce6c6b259836fb26603f3a5f19b34455b01d69454936d
|
|
BLAKE2b-256 checksum How to use checksums |
1d102e18d49984bab4ae103547be5d3143534cc1dc4b9ace095d2050378fbd19
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp313-cp313-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp313-cp313-win_arm64.whl |
|---|---|
| Size | 6.2 MB |
| Tags | CPython 3.13 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
a4eeb9c7462c1eb5eb743654156bee61dc7ecbb4f02e517e0f970aa57615ed3f
|
|
BLAKE2b-256 checksum How to use checksums |
94e02640f2fef4fbeff0df93fe6679ccc96ac20ccef0b40e62bd97299caa583a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp313-cp313-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 8.6 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
78989210c6e44578e1e67f104ff563715010c57d6b26e1fb5cdadcb1bb575f35
|
|
BLAKE2b-256 checksum How to use checksums |
e71ca0339642dcfba4bf5ccc4ace1d47f865d7a66f2dafbe431eb3cc0bb6899f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp313-cp313-manylinux_2_34_aarch64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp313-cp313-manylinux_2_34_aarch64.whl |
|---|---|
| Size | 16.8 MB |
| Tags | CPython 3.13 Linux glibc 2.34+ ARM64 |
|
SHA-256 checksum How to use checksums |
a4627132c2b354c57aaf2b67d4ce786fe7ebac04268727f93be679d4483cb60a
|
|
BLAKE2b-256 checksum How to use checksums |
4aef16957fa3f574f373b5539d82ec585501d0c3a06189354e938b5e5720be88
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 16.7 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
0b0987518e8b8cb0d391195b8c7fb74edcc00145b8b6bb0fcc8842db2391a9e3
|
|
BLAKE2b-256 checksum How to use checksums |
554b75c4c202785022ee3032fc952d597892936b22ff74b2a545a8f8133288c6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp312-cp312-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp312-cp312-win_arm64.whl |
|---|---|
| Size | 6.2 MB |
| Tags | CPython 3.12 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
24fb3f3458768d23f064610bc550a7a811f03d0876a2692953f42f5514b98845
|
|
BLAKE2b-256 checksum How to use checksums |
141435259828c321ab91d878de7a596be6d0426b354138fca80268169b52e108
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp312-cp312-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 8.6 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
138a0a2538f035514206866c5cfc1821e225874c7478ece276e659fb97b798a0
|
|
BLAKE2b-256 checksum How to use checksums |
f97f40dad15877446000c8e4828f9795f7f40232c37f4642e813df16d45f264a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp312-cp312-manylinux_2_34_aarch64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp312-cp312-manylinux_2_34_aarch64.whl |
|---|---|
| Size | 16.8 MB |
| Tags | CPython 3.12 Linux glibc 2.34+ ARM64 |
|
SHA-256 checksum How to use checksums |
1205e175cf58bd50b921d211cb4118c5ff5f8402b97ee4feafc118bfb6c9a8ea
|
|
BLAKE2b-256 checksum How to use checksums |
58bb431542d1378847a05a7ba1a6d2d56be9f4d3e3e5f31b6e830f16cda73dc6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 16.7 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
739f316a48045fbf572b04c77754e7b0a526343bdff32c0f2ee0b3b397688b60
|
|
BLAKE2b-256 checksum How to use checksums |
c7ecba2029d5c5ef71f01a29629c4fc0f35cbfa7a31f42720279ce2b61c84dc6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp311-cp311-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp311-cp311-win_arm64.whl |
|---|---|
| Size | 6.2 MB |
| Tags | CPython 3.11 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
02822fbc7c19818aa306bb4fd020b8681b99fda6727f2ee80ba2bd66c5236d99
|
|
BLAKE2b-256 checksum How to use checksums |
55357c63a0babfb8db51bcd2254e6c740db782b83426bb9c0088acbf19844870
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp311-cp311-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 8.6 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
9a2cbc35a86ae71f2a2c0f2b6f7b0317f31192d59335fb4946bc38b9e4d6d33a
|
|
BLAKE2b-256 checksum How to use checksums |
178c62217f7470851ec1faeee2fc35b2654b10a22d1d5a835f68c9ee13e9bee9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp311-cp311-manylinux_2_34_aarch64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp311-cp311-manylinux_2_34_aarch64.whl |
|---|---|
| Size | 16.8 MB |
| Tags | CPython 3.11 Linux glibc 2.34+ ARM64 |
|
SHA-256 checksum How to use checksums |
4a51d04b2233eeb0ba8a6d9b8b533a50eb0e03a141227751672fc8e144be1c10
|
|
BLAKE2b-256 checksum How to use checksums |
5ca43fd07c9f3ac8d837baa1e4a359cd6096a5e2fe94ef88f5897946d21e36e1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.18.0-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.18.0-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 16.7 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
a7c98edf63a73eefa2d47aab5a8fedbabdfa69fab94de751e29ea369bd997297
|
|
BLAKE2b-256 checksum How to use checksums |
59f193359e45bdff23a2366b255cb0362d1a8a086b7442e7b1f7a83e256ac46f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
