Skip to main content

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Metadata

Release files for onnxruntime-genai 0.17.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for onnxruntime-genai 0.17.1
File
onnxruntime_genai-0.17.1-cp314-cp314-win_arm64.whl CPython 3.14 CPython 3.14 Windows ARM64 Details
onnxruntime_genai-0.17.1-cp314-cp314-win_amd64.whl CPython 3.14 CPython 3.14 Windows x86-64 Details
onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.1-cp314-cp314-macosx_12_0_arm64.whl CPython 3.14 CPython 3.14 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.1-cp313-cp313-win_arm64.whl CPython 3.13 CPython 3.13 Windows ARM64 Details
onnxruntime_genai-0.17.1-cp313-cp313-win_amd64.whl CPython 3.13 CPython 3.13 Windows x86-64 Details
onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.1-cp313-cp313-macosx_12_0_arm64.whl CPython 3.13 CPython 3.13 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.1-cp312-cp312-win_arm64.whl CPython 3.12 CPython 3.12 Windows ARM64 Details
onnxruntime_genai-0.17.1-cp312-cp312-win_amd64.whl CPython 3.12 CPython 3.12 Windows x86-64 Details
onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.1-cp312-cp312-macosx_12_0_arm64.whl CPython 3.12 CPython 3.12 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.17.1-cp311-cp311-win_arm64.whl CPython 3.11 CPython 3.11 Windows ARM64 Details
onnxruntime_genai-0.17.1-cp311-cp311-win_amd64.whl CPython 3.11 CPython 3.11 Windows x86-64 Details
onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_aarch64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.17.1-cp311-cp311-macosx_12_0_arm64.whl CPython 3.11 CPython 3.11 macOS 12.0+ ARM64 Details

Total release size: 149.6 MB

Release files / onnxruntime_genai-0.17.1-cp314-cp314-win_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp314-cp314-win_arm64.whl
Size 4.2 MB
Tags CPython 3.14 Windows ARM64
SHA-256 checksum
How to use checksums
f5a2238d1b6e3e16cfef1f747e973478a1caf3e3d2f9776a6c968479a5e33195
BLAKE2b-256 checksum
How to use checksums
89d14c3437523a1b9b5e6087aadefb44ef8f6f2e90131d1f0245a190f9f1864a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp314-cp314-win_amd64.whl

Download URL onnxruntime_genai-0.17.1-cp314-cp314-win_amd64.whl
Size 4.4 MB
Tags CPython 3.14 Windows x86-64
SHA-256 checksum
How to use checksums
de9055ff037934cb365a6603196fe4af9f4f4ceec3759717008c04a0b80f4a2e
BLAKE2b-256 checksum
How to use checksums
fb599bf52b37392bcf36f6e5d4a101afad6759defae3af58f846e4bdae255559
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.14 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
e610ec3d9c6c234ac65af160443121effe717dfef7d59e11f53afc7a24d8f80b
BLAKE2b-256 checksum
How to use checksums
664754c0732a79f4e4946515ddbb3d15693ccad41b275e823294fe1fc7707011
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.1-cp314-cp314-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.14 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
899573820d341a715b539921c1d8615fc437a79d7f0a8c0d04f1f0c05e784b0e
BLAKE2b-256 checksum
How to use checksums
84efc3e2cd94ce4391cd4dfe8330c78c01a5c7c5baaae8c0d4eb17d699fcab8c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp314-cp314-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp314-cp314-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.14 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
d64ee373a5e5dc07339b3bf49cde739c1bd020424bdcd3aac119f1b506cdb6c7
BLAKE2b-256 checksum
How to use checksums
860121d5eda82404bc78cfb0b22ca314cbb19aaf395f60ddc16f21a79bfbab7a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp313-cp313-win_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp313-cp313-win_arm64.whl
Size 4.1 MB
Tags CPython 3.13 Windows ARM64
SHA-256 checksum
How to use checksums
3d3b6c12981ebee1563bcda0d57ae66bf5f2a3286f5d82ee18fe649987270219
BLAKE2b-256 checksum
How to use checksums
d4a9eceeba504152a003631491c2279be2ac1376f8c6667bd84348d84eece09e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp313-cp313-win_amd64.whl

Download URL onnxruntime_genai-0.17.1-cp313-cp313-win_amd64.whl
Size 4.2 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums
aed145fc2e6c801d4e45a80b4961d996eae9e270e27f2c7ffca016242efabfad
BLAKE2b-256 checksum
How to use checksums
1fa9f13ee703497735c64ca6ebb763a14e86a46c468d56feeab6e3b6d6220772
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.13 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
a1541334e4634fbfd5a0566898171bd6efbb703e5988de1b5c6e1af4fa5fe72c
BLAKE2b-256 checksum
How to use checksums
2424639bdec9f2ffa884bcaf35f885a74bf81cda00cf2b054f5663df80020c91
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.1-cp313-cp313-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.13 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
d1b37e2068db05386321809a0425d7658dd084fbb2e0096875498e99d5d9ca51
BLAKE2b-256 checksum
How to use checksums
58a6bb19e58954efd828d9d7ca32da792071d7c4812accfe23e8a23bde8f5f5e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp313-cp313-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp313-cp313-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.13 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
2497a044b9a3043dd3ec73e7e7f80ddfd7b8772f48e1dec39be7312d7440e763
BLAKE2b-256 checksum
How to use checksums
44524b1ec8466e1d7acda4b4dc2c3372658309870c560b06d5e4b7c7ef53a3bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp312-cp312-win_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp312-cp312-win_arm64.whl
Size 4.1 MB
Tags CPython 3.12 Windows ARM64
SHA-256 checksum
How to use checksums
8f9fe06c0240f704215fb175597f72298e7d14d9cc9fe1d739ce77e295a17a0e
BLAKE2b-256 checksum
How to use checksums
3ab0c92c40901d00edb38e2562249a927ed733df7774aec8b87aba067ee24f91
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp312-cp312-win_amd64.whl

Download URL onnxruntime_genai-0.17.1-cp312-cp312-win_amd64.whl
Size 4.2 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums
7c7e6ec20710059f8f72f2fad1e9127eb955cd9059b1321da6f15374b1b0ba78
BLAKE2b-256 checksum
How to use checksums
d936a4e1da428d99190453de629a4d4b30c47c81c366d2060daaa1a9acb097d4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.12 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
89ad23eddcb24158809ad83fdd3a7a88e5928a0026ca7cd6baa0807b0d6cb579
BLAKE2b-256 checksum
How to use checksums
f0370acfad3db76f97d890b2aa71e29b795693b0ff89158086ea2957b88a5655
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.1-cp312-cp312-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.12 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
a887b1bd47a0fe197d5af87bffe4af5e08c9a18186abaea3508532543aa25139
BLAKE2b-256 checksum
How to use checksums
ee65efede2fc12a1cad861615f2ab959bb3bc30a22cd494fbbb315d9d4551720
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp312-cp312-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp312-cp312-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.12 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
507a9c31405475861d1615685af0bd31b4743e7bfe1483493f6172c7b6923d81
BLAKE2b-256 checksum
How to use checksums
338f82dc39e40fe475b1d235da8f9b7afef1831a44dea6bf666d53ff6805d96d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp311-cp311-win_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp311-cp311-win_arm64.whl
Size 4.1 MB
Tags CPython 3.11 Windows ARM64
SHA-256 checksum
How to use checksums
bb9b75fae73f7085e99b12c4e144f51ce475bfaaad5126601c010c8331a2f3eb
BLAKE2b-256 checksum
How to use checksums
6b8a2d42461cd93835dbea7ea197c78d00fd27557de6ae6751adec56af29f667
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp311-cp311-win_amd64.whl

Download URL onnxruntime_genai-0.17.1-cp311-cp311-win_amd64.whl
Size 4.2 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums
b3c2e2e74fc552ae2822af72904d3f2b4c5f6dd9b4992816a9d6ccba27c4de11
BLAKE2b-256 checksum
How to use checksums
f5f37d1e4eb3e4e3b123fe92a46c66f0b680a320056c8107d9244d00632630d3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_x86_64.whl
Size 12.3 MB
Tags CPython 3.11 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
8f3c758bd618c4ab69baf56382f833cd22bff338c1c82eb86694b63019f4369c
BLAKE2b-256 checksum
How to use checksums
0e1d7e3e8c46d1d3ec2b6d75cd661341b90ce20afae8515a02cd53193e29cd4e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.17.1-cp311-cp311-manylinux_2_28_aarch64.whl
Size 12.0 MB
Tags CPython 3.11 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
24544626461f87d49e56f54bb9f5518d4042ed7e976e016047e257f3a617cc07
BLAKE2b-256 checksum
How to use checksums
461405e8921bd0a1fc94ce2b264ece500c85d75b19007fc02fae6058f6ce8e43
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.17.1-cp311-cp311-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.17.1-cp311-cp311-macosx_12_0_arm64.whl
Size 4.7 MB
Tags CPython 3.11 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
33007954b23fc53ca4ee6829099a8dabe2738604ddc592abcd5c3d88853e4a10
BLAKE2b-256 checksum
How to use checksums
ad596bf79008cae0358591cbac06b87a5462a33dd5465f0b2f62184e5bc6e443
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release history Release notifications | RSS feed

This release

0.17.1 This release

20 release files

0.9.2

18 release files

0.8.3

18 release files

0.8.1

18 release files

0.8.0

18 release files

0.7.1

18 release files

0.7.0

18 release files

0.6.0

18 release files

0.5.2

14 release files

0.5.1

14 release files

0.4.0

12 release files

0.3.0

10 release files

0.2.0

10 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page