ONNX Runtime GenAI
Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.
For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai
Release files for onnxruntime-genai 0.16.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 151.0 MB
Release files / onnxruntime_genai-0.16.0-cp314-cp314-win_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp314-cp314-win_arm64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.14 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
98119ac8c6cb15a804b32c60ac5add6dfaf34282578d3989a49e5d2cfc4d982a
|
|
BLAKE2b-256 checksum How to use checksums |
2ed7638adb37e89f89f41550ef1c697b86e3dbc92125a35de50466f821d2b4b4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp314-cp314-win_amd64.whl
| Download URL | onnxruntime_genai-0.16.0-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 4.3 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d68e66ba0e34167f829daf9e5192c0469e5095dfa9cdb28239ba85895c2e8138
|
|
BLAKE2b-256 checksum How to use checksums |
5bbe6cb99acae1e9b7c581c88790d5ee1b82bd9f7333b385a2ab2b742f8450dd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai-0.16.0-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.4 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
4a1391019a406fbd8ae0f5ee6735ba567723428535ad6ca8a886f1631c1d58f6
|
|
BLAKE2b-256 checksum How to use checksums |
05aeddf4428cd3b7f55e19efa446eeb566700cc4a73b83ad3b5fc9ba8d5e3753
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp314-cp314-manylinux_2_28_aarch64.whl
| Download URL | onnxruntime_genai-0.16.0-cp314-cp314-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 12.0 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
1971928ff77a8921a13577ab27c222fe2472c8753750f5ff7452486951389b71
|
|
BLAKE2b-256 checksum How to use checksums |
3116f6d943193c9410c12bbe87f7254b96947a821760b85a3a335a753b0d6750
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp314-cp314-macosx_12_0_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp314-cp314-macosx_12_0_arm64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | CPython 3.14 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c97211424848d0af000a4afee875d56d39a2ab323a07a9dc9a605cf247cf3a5c
|
|
BLAKE2b-256 checksum How to use checksums |
0b8bfa508caec8292243d4596ae2763f0d3a0ce3d71e58fbab89fc4d74600808
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp313-cp313-win_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp313-cp313-win_arm64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.13 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
680d9cf44e73531fd75b0d2cc92144388284183d39ce2ae2d31d136d0827cec4
|
|
BLAKE2b-256 checksum How to use checksums |
9b9615b9b9f6645211f0781a030add5b628d0dc81bc7518ab2d5821575de92b0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp313-cp313-win_amd64.whl
| Download URL | onnxruntime_genai-0.16.0-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
cf78c965d31c19e9351cb6f0985c77e8f097b7fb527385a096bb5ab386cc3598
|
|
BLAKE2b-256 checksum How to use checksums |
f78cb877b104f70d9e2ad21435f1fdf46a95ec9377c94c6fd80a2a5426c0b227
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai-0.16.0-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.4 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
67113fa9434fa44d6b97c92b2dcd7623941ed924a948a84945bd084267dcf3c0
|
|
BLAKE2b-256 checksum How to use checksums |
d0c30e679dcb7d030bc182cad706a183031ce71d6d2ecf3463050aae7f547072
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp313-cp313-manylinux_2_28_aarch64.whl
| Download URL | onnxruntime_genai-0.16.0-cp313-cp313-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 12.0 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
172379c4c1e28eefa591dedfec8b272da31f73aa988b594022eee6123db8b01f
|
|
BLAKE2b-256 checksum How to use checksums |
0837b6355e2248929c0ce21bf4358895840a5e6bab3c759c053952a375064fa6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c18ebf88a06547dea3bfec78b38cdeab415d2268230110fa1f600622fa8636db
|
|
BLAKE2b-256 checksum How to use checksums |
589ab8b70ad3f30d5617bbfe0e1a6f474f01c5c2c507ba7b89c4035091eba44b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp312-cp312-win_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp312-cp312-win_arm64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.12 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
f3bdf8a701e761c427449a68f88aa26de0b6fcfaf6084b605a5bb1ff7a623742
|
|
BLAKE2b-256 checksum How to use checksums |
4df41ed79731608b8e6dc52b6b25e92e0596750e30a04aebaa22c55913bbe3f5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp312-cp312-win_amd64.whl
| Download URL | onnxruntime_genai-0.16.0-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
4427d8f3a6a9f1a77c1cdfb9efc1a9af518ab78bd70991db3eb9eae3ac7bdc56
|
|
BLAKE2b-256 checksum How to use checksums |
8de32e79dea57d8e2dcdbfd985825d8044f994a174cf9cfe98b29ee3af407589
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai-0.16.0-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.4 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
0fd61645bdffedc644cba9e02001082d28d5cbf92e705925ea1a769bfeba3d8c
|
|
BLAKE2b-256 checksum How to use checksums |
f56a3732820f12d502f6fe094bb4ff0edb490fe72cf970bb62c07b803672bda4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp312-cp312-manylinux_2_28_aarch64.whl
| Download URL | onnxruntime_genai-0.16.0-cp312-cp312-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 12.0 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
504b9ec876fe35d83f01b53816ee0091ca4be7c1673806947f20754643fb5f77
|
|
BLAKE2b-256 checksum How to use checksums |
84c536a3d6be3f4742bc1d658329196b7a791c55c5771230d3ac20e9415ad583
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
1a861b2176424fa172795250bb0c2326be1340538706f454bffef7e70918702b
|
|
BLAKE2b-256 checksum How to use checksums |
a0ba8ad8cdf62ee816e019a9b3f56bf2cb2a63629a9aeeb0cf9d1a256dc28d5d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp311-cp311-win_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp311-cp311-win_arm64.whl |
|---|---|
| Size | 4.0 MB |
| Tags | CPython 3.11 Windows ARM64 |
|
SHA-256 checksum How to use checksums |
f03e10999e94dd07fac03c09d8324efd43a91e80c24edeeec2d4bc482d274362
|
|
BLAKE2b-256 checksum How to use checksums |
ae6cc6ae039f282500e3fb2b343e0b6069ca30424160481c12e097a24ddbff08
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp311-cp311-win_amd64.whl
| Download URL | onnxruntime_genai-0.16.0-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 4.1 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
a0bdf1b2d8af6bcaa8e3ba0d4cffa89f21ffac91a879c2a9671cba9f4909d3a1
|
|
BLAKE2b-256 checksum How to use checksums |
4e2af5e15f6ec3b0f6a6a283c9c60e6b8163afd4d4570d05602e1bd6a9d0d842
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | onnxruntime_genai-0.16.0-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 12.4 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
61266612b274a0fc737f99624ab2f3f495b5965fd842e03c5c9a0b5f5b32825b
|
|
BLAKE2b-256 checksum How to use checksums |
a8c268f0275290f501f82d8ee48a9077bec290e72f4eb4d391311b21163f4d57
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp311-cp311-manylinux_2_28_aarch64.whl
| Download URL | onnxruntime_genai-0.16.0-cp311-cp311-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 12.0 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ ARM64 |
|
SHA-256 checksum How to use checksums |
27a9242b82e49e828514065c4fa135a6775257315fd5eae0d8ff7e9c6750cf42
|
|
BLAKE2b-256 checksum How to use checksums |
fdc6cd437c9fb1269e028df84375cb9f1a59c3f3a63b336ffe0b05bece189fc5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
Release files / onnxruntime_genai-0.16.0-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | onnxruntime_genai-0.16.0-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
331461026e4841499890a96839a22897caa07e9f954bea0f84a72e700d1948bf
|
|
BLAKE2b-256 checksum How to use checksums |
f39eb84067ccee46d916fec82a4db3eabd4e8fe69238ff908dbbe1117550950d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
RestSharp/106.13.0.0
|
