ONNX Runtime GenAI
Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.
For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
Release files for onnxruntime-genai-cuda 0.16.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 129.0 MB
Release files / onnxruntime_genai_cuda-0.16.0-cp314-cp314-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp314-cp314-win_arm64.whl |
|---|---|
| Size | 6.2 MB |
| Tags | CPython 3.14 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
f127adec7f475386eab96be6d5f99947d3aaf5d67d7bd95b28802062f28fc31d
|
|
BLAKE2b-256 checksum How to use checksums |
0034438c5a156fefe93a860891729f293c920539665696eb5f5a9d2f520c7ff6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp314-cp314-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 8.6 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
97566f7965f7f5d8e7a57ee8127161911cdd39223e14dc8ee82e86e9342719f5
|
|
BLAKE2b-256 checksum How to use checksums |
a49dc136c34f40a864b1d96dc202d963f56ed25cbf5caafbd1a97d0d445ff9fa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.8 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
baee3a6f88c29d26b7c4c80d08bc72b79a76a12a7ec91899112775e18071d536
|
|
BLAKE2b-256 checksum How to use checksums |
f5ba84a8ebaa22f62e6aafc8d8ed89a72a696755f8541bcb17d2851a7c7a62ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp313-cp313-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp313-cp313-win_arm64.whl |
|---|---|
| Size | 6.0 MB |
| Tags | CPython 3.13 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
c8e6c6cb1f02b9ab38482a21a98eabaf89e5903664d52bf6b8d4f96d2904c67e
|
|
BLAKE2b-256 checksum How to use checksums |
b23e61b058e54932fd282cdf6d118e83018d2f1b1dd3081434de39a940560ae2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp313-cp313-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 8.4 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
5367e6508592d9a26050eb24b1ac62569de6be738c9eaa067a580143ce4f495f
|
|
BLAKE2b-256 checksum How to use checksums |
1168ad70cfb0bae2c368bc44f1404894a305f0c74c4f011dbdf4d08ee2ecbae3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
e3099e28861a2b2eca253a4935e4b9af9c79a06ab2de5eb9972e66c25df8eb41
|
|
BLAKE2b-256 checksum How to use checksums |
a675d96760dc972d4f9cd2eb828b14cfd461a5a61153b1b267071e5c9f60140d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp312-cp312-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp312-cp312-win_arm64.whl |
|---|---|
| Size | 6.0 MB |
| Tags | CPython 3.12 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
eebda04c82dbf395c1f953983311ea024937e4e35867982e800bb08753285b03
|
|
BLAKE2b-256 checksum How to use checksums |
57c34d362c32482ad69270c120ceace4ca4f3cb340aadd56451715902e0bd107
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp312-cp312-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 8.4 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
c43057e1c381cecd65e0aa2a8a1820530a162182c344eae183bcb0274a234155
|
|
BLAKE2b-256 checksum How to use checksums |
c553410e4113f1c037b367401af81db6bd61ed45fdd6dc74390bf097473f146b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
ca5ae7dc4c533c56dca5919d8b720c2ed90fa4ef324464da13dbf966124674d1
|
|
BLAKE2b-256 checksum How to use checksums |
d1611e49d6c7c29bf7c4913816c8176bca9662663181f56f26b955e77ec505b6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp311-cp311-win_arm64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp311-cp311-win_arm64.whl |
|---|---|
| Size | 6.0 MB |
| Tags | CPython 3.11 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
6357696c9e4ed6ecb540826aca1734726fd48ff9b8b9dd8d141df291cb3bfd79
|
|
BLAKE2b-256 checksum How to use checksums |
c901c81de0b47d5059ac291f80f4a636caaf6c94909b19aa7f17ed986065073e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp311-cp311-win_amd64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 8.4 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
34dcff344685cd1f7f807f27de5d1402f8b6a85271038e8ea7440e0beeaf2825
|
|
BLAKE2b-256 checksum How to use checksums |
f179ab174c58aaab55459efec672a68b2ee0e001b5bd876584d79164438bff08
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai_cuda-0.16.0-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai_cuda-0.16.0-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 17.7 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
132c772de446e44c7160ffec7a7b0a383a10a1a558d71a260ae6bd59a5def185
|
|
BLAKE2b-256 checksum How to use checksums |
8b98bb2c1514837863db169ca9c11bb127432e37ae19231f4369a6a0dcfc340d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
