ONNX Runtime GenAI
Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.
For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
Release files for onnxruntime-genai-cuda 0.17.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 129.6 MB
Release files / onnxruntime_genai_cuda-0.17.1-cp314-cp314-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp314-cp314-win_arm64.whl |
|---|---|
| Size | 6.3 MB |
| Tags | CPython 3.14 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
df94a61e7000f9d22a47d5dd3d44c2fecb204835c4c21697a817abe349769e1d
|
|
BLAKE2b-256 checksum How to use checksums |
9db056d1a619f8e27fd28351e72f8cd18d3942b2034dbadb65461ea7ae851cb1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp314-cp314-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 8.7 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c562d613af04dd27878b4e6876765caa8964b4b8837ca4e0d2c8fa2201d251fd
|
|
BLAKE2b-256 checksum How to use checksums |
78b9e7e63830510346193bb6da671180e8dff4dbbe93f5d2aeb3707f041fd1f1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
32080d3d2eeee520a20207e6d62580d7c9b27549e68a17e6d96fd877459090d6
|
|
BLAKE2b-256 checksum How to use checksums |
3ee085f53fe4133954d9cd2c4920040acd2fbb42a52c049e82654be7641db70c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp313-cp313-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp313-cp313-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.13 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
0b93dd251eec6f76148997a5002c35fd07f1646d6405ef7e1ee23987772acc87
|
|
BLAKE2b-256 checksum How to use checksums |
b5c2a7407b8806e384a13430707c4b86ae7d43f72834ac9384c068c2cb57ac3a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp313-cp313-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
b8576f68d3b2fb718de0054df7d74edb70293ece824d1ff361b213b15639979a
|
|
BLAKE2b-256 checksum How to use checksums |
7d0195358e9126ee96498e89c50a633c60f78b89290c6357bbf94bb944f2717a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
1f8f23b1e97e65333f64a5d7abfae67f89154ea5bd181db6cda54c5089260c3a
|
|
BLAKE2b-256 checksum How to use checksums |
a6409667ed539270b9bd23565b683ec67d37ae4a64728297f1d4f7eb357df528
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp312-cp312-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp312-cp312-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.12 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
5ba61eab3b50a11a57d7efaaf8e77261a1afaa80fb21edcc81f99da9f39ae090
|
|
BLAKE2b-256 checksum How to use checksums |
d43691ba3a8fc55b55b39376e6a776222ca96d0450d913a13a963c81d123e67d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp312-cp312-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
e7049b50d256e07628d23b7c9f7de120c454594489805a4d06da6ab5965a05ba
|
|
BLAKE2b-256 checksum How to use checksums |
d7cb24054f77b06e093cb91cff177b11e3584201f3fdf593ffc3413beaa69586
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
4ab2f602bcf1f8761d05e28a6d825bc515a3289316b4134654e4d80268f87940
|
|
BLAKE2b-256 checksum How to use checksums |
1438323e89f6b6e5109f6443ecfa5171f585fb75f55143feee224afc18b5cf0a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp311-cp311-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp311-cp311-win_arm64.whl |
|---|---|
| Size | 6.1 MB |
| Tags | CPython 3.11 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
a7e9c39ed9e6b39f0eccc91a49d75abca7c8d3be4cc8e3ddb9ca0d569ebd0399
|
|
BLAKE2b-256 checksum How to use checksums |
015d5974749d3f21f23ec8911a94908b74726e3781916baef74a74796486b378
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp311-cp311-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 8.5 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
6fea916dc17addd4b44fc5f497b749d2ba535dfe2a6090a07d16edf6f5cde7b0
|
|
BLAKE2b-256 checksum How to use checksums |
0e146523f719684d505a2cce414f0ca1a7203d3fee6c73f9e464fdef14a09785
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.17.1-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.17.1-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
ad07bd53820151686e732cae168338afac746d695b703bc4e48be618eb4cfd13
|
|
BLAKE2b-256 checksum How to use checksums |
c8f0fd9e99c834dea479e10934148d9210c081bc9c4d3212c2f3fa984bd3453a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
