Skip to main content

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Metadata

Release files for onnxruntime-genai 0.18.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for onnxruntime-genai 0.18.0
File
onnxruntime_genai-0.18.0-cp314-cp314-win_arm64.whl CPython 3.14 CPython 3.14 Windows ARM64 Details
onnxruntime_genai-0.18.0-cp314-cp314-win_amd64.whl CPython 3.14 CPython 3.14 Windows x86-64 Details
onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.18.0-cp314-cp314-macosx_12_0_arm64.whl CPython 3.14 CPython 3.14 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.18.0-cp313-cp313-win_arm64.whl CPython 3.13 CPython 3.13 Windows ARM64 Details
onnxruntime_genai-0.18.0-cp313-cp313-win_amd64.whl CPython 3.13 CPython 3.13 Windows x86-64 Details
onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_x86_64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_aarch64.whl CPython 3.13 CPython 3.13 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.18.0-cp313-cp313-macosx_12_0_arm64.whl CPython 3.13 CPython 3.13 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.18.0-cp312-cp312-win_arm64.whl CPython 3.12 CPython 3.12 Windows ARM64 Details
onnxruntime_genai-0.18.0-cp312-cp312-win_amd64.whl CPython 3.12 CPython 3.12 Windows x86-64 Details
onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_x86_64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_aarch64.whl CPython 3.12 CPython 3.12 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.18.0-cp312-cp312-macosx_12_0_arm64.whl CPython 3.12 CPython 3.12 macOS 12.0+ ARM64 Details
onnxruntime_genai-0.18.0-cp311-cp311-win_arm64.whl CPython 3.11 CPython 3.11 Windows ARM64 Details
onnxruntime_genai-0.18.0-cp311-cp311-win_amd64.whl CPython 3.11 CPython 3.11 Windows x86-64 Details
onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_x86_64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ x86-64 Details
onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_aarch64.whl CPython 3.11 CPython 3.11 Linux glibc 2.28+ ARM64 Details
onnxruntime_genai-0.18.0-cp311-cp311-macosx_12_0_arm64.whl CPython 3.11 CPython 3.11 macOS 12.0+ ARM64 Details

Total release size: 139.1 MB

Release files / onnxruntime_genai-0.18.0-cp314-cp314-win_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp314-cp314-win_arm64.whl
Size 4.3 MB
Tags CPython 3.14 Windows ARM64
SHA-256 checksum
How to use checksums
df4312a8bb933b670a20d7c30e70a40c45d4bc719873c7cd04b98682080a88f9
BLAKE2b-256 checksum
How to use checksums
837316919441bc7f98de5fee49dfd9c7e76a80cdea44a52f82ad347fb5b2209e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp314-cp314-win_amd64.whl

Download URL onnxruntime_genai-0.18.0-cp314-cp314-win_amd64.whl
Size 4.5 MB
Tags CPython 3.14 Windows x86-64
SHA-256 checksum
How to use checksums
5f2dcc6ea9d772ea3a55455a02fab078f6ed462f006856debe65a823883035a9
BLAKE2b-256 checksum
How to use checksums
3fea699cdc3ddc546434ea11243cd25276c9c1477b417537fe93f136cd4ef119
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_x86_64.whl
Size 11.2 MB
Tags CPython 3.14 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
83b656b4efa54ff9999c9b7a409eb697ab7c8e981a7c7544302c04afe17aba0e
BLAKE2b-256 checksum
How to use checksums
91c970b85dfffa400787a71ae1e859db5b4b93ea7821362f0333f6ccfefdd980
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.18.0-cp314-cp314-manylinux_2_28_aarch64.whl
Size 10.9 MB
Tags CPython 3.14 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
5e0d37fb5509469bcf53095a312028caff52a00bc12ce7446cc642a090d12fd3
BLAKE2b-256 checksum
How to use checksums
3bcd4c09a743b3d9a23d94c83b3586a8a48e795109e7d4c4e3fe4c68dd9bd4c2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp314-cp314-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp314-cp314-macosx_12_0_arm64.whl
Size 4.1 MB
Tags CPython 3.14 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
f7ca7ed4dfd76497677d4da8c76b5421615874cf342ea06c4a75ae5e50aff73d
BLAKE2b-256 checksum
How to use checksums
5f793af39726626abb7b79448cf29e02ca6e5d46fd85408fd357250bfeb5bcb3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp313-cp313-win_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp313-cp313-win_arm64.whl
Size 4.1 MB
Tags CPython 3.13 Windows ARM64
SHA-256 checksum
How to use checksums
adfd70ab76051719a4a77f17e10b7dd67c67d2145f55360938c9f4f7ece31e11
BLAKE2b-256 checksum
How to use checksums
16d8acb47efb167e9670bd709f5632b0c5ce848991f493d7b76d500ebd679aca
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp313-cp313-win_amd64.whl

Download URL onnxruntime_genai-0.18.0-cp313-cp313-win_amd64.whl
Size 4.3 MB
Tags CPython 3.13 Windows x86-64
SHA-256 checksum
How to use checksums
c388ea51a435d2ee781f3ed56b4a450da23349bff17c5e3e43fda35c40657009
BLAKE2b-256 checksum
How to use checksums
72b0015663ac2f2231dc574cee5465552c7e6cd80a3e8d1c52b6e961f27ebbd3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_x86_64.whl
Size 11.2 MB
Tags CPython 3.13 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
5e841f51315eba711ad60c2df1cd59332387fc1cf3708ce1d2320991a1479438
BLAKE2b-256 checksum
How to use checksums
96e925005b799fb268f792f85de277c505c754e7b1558cf3b20ff413a7a7bdf0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.18.0-cp313-cp313-manylinux_2_28_aarch64.whl
Size 10.9 MB
Tags CPython 3.13 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
6423348b4bbeb3b0add66af04dea17ca8a9be229bf6946a9c460be3b589a1c64
BLAKE2b-256 checksum
How to use checksums
e1b80ff150b3e41b8a9d4426062d50440d407e60c52cfa62390a52865d6a8770
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp313-cp313-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp313-cp313-macosx_12_0_arm64.whl
Size 4.1 MB
Tags CPython 3.13 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
e2afb6fd8188456061eecc265c5cff950df383b431c5f73bf5f1f1eb70925c43
BLAKE2b-256 checksum
How to use checksums
1b4c492dcb8929e231ddbbdf67b577e75c353dce20838db2378bb9a97d5ad753
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp312-cp312-win_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp312-cp312-win_arm64.whl
Size 4.1 MB
Tags CPython 3.12 Windows ARM64
SHA-256 checksum
How to use checksums
124216f984a5ca43e4b5e73893a6a68fb23763fcb49f789f88db6813ffbe144b
BLAKE2b-256 checksum
How to use checksums
da6c4cfe08d53d31bce39b38da120c27a9f545f003f554a73ef405c9cd739e8b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp312-cp312-win_amd64.whl

Download URL onnxruntime_genai-0.18.0-cp312-cp312-win_amd64.whl
Size 4.3 MB
Tags CPython 3.12 Windows x86-64
SHA-256 checksum
How to use checksums
a60afa6ec0b9387e954a74ff6a253164943c9977589cf81ae601b5f89880df05
BLAKE2b-256 checksum
How to use checksums
f49ba86531b836730c1b7fa8af0925762dd99390df14f8e5c48e2faab753db53
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_x86_64.whl
Size 11.2 MB
Tags CPython 3.12 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
6df22d9d74a86409cf06f6af0045b999524941426dab6eba4f937ef2aed513a7
BLAKE2b-256 checksum
How to use checksums
1caddc7fe235c1ca1e411d9c3702b17d488c164f72632c4b8740c81d5ea4d0c3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.18.0-cp312-cp312-manylinux_2_28_aarch64.whl
Size 10.9 MB
Tags CPython 3.12 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
8c5af57dac86f0d0d19dc205a21119d07b438d4389f75b793462a6d877a59adc
BLAKE2b-256 checksum
How to use checksums
01a006b0e3e6b3e42d716f50c113f6e1888178d708d850a2f99fea07d014d1ce
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp312-cp312-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp312-cp312-macosx_12_0_arm64.whl
Size 4.1 MB
Tags CPython 3.12 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
6c151ca64e1cfcbbad65fb39dd698c0c3cb82b265129743ba82d6c1691411b49
BLAKE2b-256 checksum
How to use checksums
1e523c3541d484ce606ad40a0fc414517f857c13b692c2d8d097f7118c945eac
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp311-cp311-win_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp311-cp311-win_arm64.whl
Size 4.1 MB
Tags CPython 3.11 Windows ARM64
SHA-256 checksum
How to use checksums
1129f0da4f2f7c15f32dc261ebec817a466826700ec48779b9ebea433b9ee974
BLAKE2b-256 checksum
How to use checksums
4c56c16771200b072fa5796b6aef14187bbad6ebed120df73fb2222c956d88d5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp311-cp311-win_amd64.whl

Download URL onnxruntime_genai-0.18.0-cp311-cp311-win_amd64.whl
Size 4.3 MB
Tags CPython 3.11 Windows x86-64
SHA-256 checksum
How to use checksums
d468155772451d3891a2ed006b7fcf11bf6f414d300c77488f1ca27c1be038d4
BLAKE2b-256 checksum
How to use checksums
a490acb2a295fe713c56807efdecb5dbf72337ac00e2b51fbe6b1b6497d30071
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_x86_64.whl

Download URL onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_x86_64.whl
Size 11.2 MB
Tags CPython 3.11 Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
af9e2a4efb447feea2cfa10e24aedef1e4f01635c00f6cca759ee13254ee27db
BLAKE2b-256 checksum
How to use checksums
3ccbd3fe096d4447098d934070fccf52d3a5d557d6a96b29358b791bad184ef2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_aarch64.whl

Download URL onnxruntime_genai-0.18.0-cp311-cp311-manylinux_2_28_aarch64.whl
Size 10.9 MB
Tags CPython 3.11 Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
5cba84b83dcf658ebc3e124af98d6d0d3d3ccb40e9aedf7633486e95c9b7b713
BLAKE2b-256 checksum
How to use checksums
e96e33f4a61a8116512531659cde67a0ac20844bcee5968047d4a1f9003c2d3d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release files / onnxruntime_genai-0.18.0-cp311-cp311-macosx_12_0_arm64.whl

Download URL onnxruntime_genai-0.18.0-cp311-cp311-macosx_12_0_arm64.whl
Size 4.1 MB
Tags CPython 3.11 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
17423a171dbaf8ae9bd642057367c971a06fc97faf84e5ee7c10cd2608178bdf
BLAKE2b-256 checksum
How to use checksums
69cf733031749c40c84c2cb5dc8139ee21f693a5580b3d74ea4c302f71548c4f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via RestSharp/106.13.0.0

Release history Release notifications | RSS feed

This release

0.18.0 This release

20 release files

0.9.2

18 release files

0.8.3

18 release files

0.8.1

18 release files

0.8.0

18 release files

0.7.1

18 release files

0.7.0

18 release files

0.6.0

18 release files

0.5.2

14 release files

0.5.1

14 release files

0.4.0

12 release files

0.3.0

10 release files

0.2.0

10 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page