Skip to main content

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Release files for onnxruntime-genai 0.17.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for onnxruntime-genai 0.17.0
File
onnxruntime_genai-0.17.0-cp314-cp314-win_arm64.whl CPython 3.14 CPython 3.14 Windows ARM64 Details
onnxruntime_genai-0.17.0-cp314-cp314-win_amd64.whl CPython 3.14 CPython 3.14 Windows x86-64 Details
onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.0-cp314-cp314-macosx_12_0_arm64.whl CPython 3.14 CPython 3.14 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.0-cp313-cp313-win_arm64.whl CPython 3.13 CPython 3.13 Windows ARM64 Details
onnxruntime_genai-0.17.0-cp313-cp313-win_amd64.whl CPython 3.13 CPython 3.13 Windows x86-64 Details
onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.0-cp313-cp313-macosx_12_0_arm64.whl CPython 3.13 CPython 3.13 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.0-cp312-cp312-win_arm64.whl CPython 3.12 CPython 3.12 Windows ARM64 Details
onnxruntime_genai-0.17.0-cp312-cp312-win_amd64.whl CPython 3.12 CPython 3.12 Windows x86-64 Details
onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.0-cp312-cp312-macosx_12_0_arm64.whl CPython 3.12 CPython 3.12 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.0-cp311-cp311-win_arm64.whl CPython 3.11 CPython 3.11 Windows ARM64 Details
onnxruntime_genai-0.17.0-cp311-cp311-win_amd64.whl CPython 3.11 CPython 3.11 Windows x86-64 Details
onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_aarch64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.0-cp311-cp311-macosx_12_0_arm64.whl CPython 3.11 CPython 3.11 macOS 12.0+ ARM64 Details

Total release size: 149.4 MB

Release files / onnxruntime_genai-0.17.0-cp314-cp314-win_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp314-cp314-win_arm64.whl
Size 4.2 MB
Tags CPython 3.14 Windows ARM64
SHA-256 checksum
How to use checksums
3d8bbae6b99b25180bb485e31cd6627038720b0655e50a6254a9f51a7369df2d
BLAKE2b-256 checksum
How to use checksums
26043d26f1175a4ebe23e4680048b5ccc8c8247f0e1368ef63f52bf07ce26cd4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp314-cp314-win_amd64.whl

Download URL onnxruntime_genai-0.17.0-cp314-cp314-win_amd64.whl
Size 4.4 MB
Tags CPython 3.14 Windows x86-64
SHA-256 checksum
How to use checksums
fbfc6c15641b470b1a849fc7cc8094b36a095feaba39b3e291c4f8ebb663fa5d
BLAKE2b-256 checksum
How to use checksums
235d29adf59a77063e231a5729e1dda40a86ce8824cf3d1ac7e53414a2190db2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.14 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
ce2a30d72fdd6ed26f6a2874c85d39f467b9e7eadc0e59e670ad8335b6491fef
BLAKE2b-256 checksum
How to use checksums
79ede673e47e092252c43b17025760769e291c015f766912a7f4063772efe459
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.0-cp314-cp314-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.14 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
2aa5604c62b3926f1a9c12f5690d4509116381faf15dcf5708fb9b718366b47f
BLAKE2b-256 checksum
How to use checksums
addb1058770cd4ccfd4e846a6e8e843b119293b29f247cdeeb1eb5ffb1f90cac
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp314-cp314-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp314-cp314-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.14 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
0096bff445d0d70438458eec17411e3a624746d216da0123116ff379f657c33d
BLAKE2b-256 checksum
How to use checksums
73ae48e524e8862d681ec69dbb5fff28029cf2bfeb05e63d3f7cb593e582e494
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp313-cp313-win_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp313-cp313-win_arm64.whl
Size 4.1 MB
Tags CPython 3.13 Windows ARM64
SHA-256 checksum
How to use checksums
57ef04ef5b7526c9da1875d20afb1099cdd6120d1aea37fc31043f68b3aeaab5
BLAKE2b-256 checksum
How to use checksums
1ededee5841ae9416da66473c86544e7460f58cfa844145f35dd2e0967860bd7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp313-cp313-win_amd64.whl

Download URL onnxruntime_genai-0.17.0-cp313-cp313-win_amd64.whl
Size 4.2 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums
02d554c79c1ee386a0907206719b11bedcc04d6b25ef330c8bdad50834513b96
BLAKE2b-256 checksum
How to use checksums
2767708e971881f8974214abfa01106fb1ea21677e4c3d8e83407f5f310a8ff0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.13 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
0654d94aa6a6229de57fb0f67161b57e3a9cafa166cc6bf1ed77056a448d59fa
BLAKE2b-256 checksum
How to use checksums
824c33c37ae18b9807d0e11c8c8a6f0cf970f33004ae0492311fcc6d06d6dcc0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.0-cp313-cp313-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.13 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
19ff928cdae464d05524254541693f7cde0d3ec6363f8289182c556590dd3fef
BLAKE2b-256 checksum
How to use checksums
dd3bc0f38b373d16827eb6f03f903285460f8f48f5bba8447ca2b22cc88aa0b2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp313-cp313-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp313-cp313-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.13 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
136c183abe436543d1940fe824b49b0b48c5989fb2a40c99db5536b02f6fa9c3
BLAKE2b-256 checksum
How to use checksums
6d0e6f07c6971ee54c3982ef3e48c7b758d5bdafcf58fb58b08a8f0126d5d53f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp312-cp312-win_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp312-cp312-win_arm64.whl
Size 4.1 MB
Tags CPython 3.12 Windows ARM64
SHA-256 checksum
How to use checksums
3953c5ec530084b76af91b12d6fea56d9522d9c16d573af0a90d703274976321
BLAKE2b-256 checksum
How to use checksums
0f539d5a6cf410648f7401b32bb2b8e2d5397871a11f725cff193106bba2a1bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp312-cp312-win_amd64.whl

Download URL onnxruntime_genai-0.17.0-cp312-cp312-win_amd64.whl
Size 4.2 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums
0649574e0e33fcdd9b1c92b92e4953c9c02af8233e3a22b9361211e7d0358c29
BLAKE2b-256 checksum
How to use checksums
316fe96ed3b93156e6a5dbfdd41c15e25e65805f820d7887e8a6fe5ff1f66213
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.12 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
549e57fabb231579a713502b43139004a8c9fe66890599831a79d608635ff6af
BLAKE2b-256 checksum
How to use checksums
4b08b7b5a72d150262567d0856a8e2a044fd0ee9f1a544384c7c8b7b62351e2f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.0-cp312-cp312-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.12 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
eb828a4a6ab524849c69a68236c263819d4d2ad10c3cc2144505a03dc08926d0
BLAKE2b-256 checksum
How to use checksums
e43b155fd470cfeb79466b1065f2f6b4f1d128cc0ca84446f9629a720928dc58
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp312-cp312-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp312-cp312-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.12 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
dc7028a6f62a76168225fe1dc68c24e9f0b0d6ecdc4951bc08953a58e99b315c
BLAKE2b-256 checksum
How to use checksums
022d043bcfe6cee3014af5869f46a2e7ecd9f3726466eb8ce34720f7c4d41578
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp311-cp311-win_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp311-cp311-win_arm64.whl
Size 4.1 MB
Tags CPython 3.11 Windows ARM64
SHA-256 checksum
How to use checksums
42882032b1502c8acc068d9471de5d0115357601037a20ac723f044b1dfa96b1
BLAKE2b-256 checksum
How to use checksums
e9c8bbf41b0e1edc7297547a98ce41ad2dd702d192b92c85afff543d78dd1bf7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp311-cp311-win_amd64.whl

Download URL onnxruntime_genai-0.17.0-cp311-cp311-win_amd64.whl
Size 4.2 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums
68798c274a7b2cfc7c5a8fe3f5a64e0ea7a016c0e407a42dc5d159f031ed3c34
BLAKE2b-256 checksum
How to use checksums
67d332ea7a88f2c496617a2af66d603de7dbb6a12da1a43714c1e5b406462d61
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.11 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
05e8b21b49f3a87584896332a6d90bc33722a5b0b9fc81ad14787615935e2de7
BLAKE2b-256 checksum
How to use checksums
2e33cda44b7c39fb0bd8a4f8acdd06c7eebccbb0ea41ccf03a8b6c310292ec2c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.0-cp311-cp311-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.11 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
79f09e67a9b3c5e571c19d915b8e0e76770e897c4edf4a19bbea83a0cafec63e
BLAKE2b-256 checksum
How to use checksums
937d68c9cb5c6d7cbab63e791bd878d381b6cc60f916e4aa8dd9a824eb986551
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.0-cp311-cp311-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.0-cp311-cp311-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.11 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
60eaed4beee9a0ef7369edafa1638e4128e9d4bea70e47d23283487ac51236db
BLAKE2b-256 checksum
How to use checksums
96bbedb6670f58f845e5469c26496ccb567f2ac1690d107de46aa60fa23373ba
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release history Release notifications | RSS feed

This release

0.17.0 This release

20 release files

0.9.2

18 release files

0.8.3

18 release files

0.8.1

18 release files

0.8.0

18 release files

0.7.1

18 release files

0.7.0

18 release files

0.6.0

18 release files

0.5.2

14 release files

0.5.1

14 release files

0.4.0

12 release files

0.3.0

10 release files

0.2.0

10 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page