ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.15.2-cp314-cp314-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.15.2-cp314-cp314-win_amd64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.2-cp314-cp314-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.15.2-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.15.2-cp313-cp313-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.2-cp313-cp313-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.15.2-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.15.2-cp312-cp312-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.2-cp312-cp312-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.15.2-cp311-cp311-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.15.2-cp311-cp311-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.2-cp311-cp311-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.15.2-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 13d930e2d58fd158e22bef29a6e741d808426089f6eaf82f3a31aaef4c518432
MD5 253bf1e6b8f8d6caeca876f456a3be2c
BLAKE2b-256 b869f4e8088976d5358d573cc3efbdad17f1912ca4f50aa6c65778ba460bb6a3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 c00a906ce90e913150ee20c0148330edd985f18f67b93752fceb1f165ac26f02
MD5 caa7c6c98d88c799b5daab4ca5039126
BLAKE2b-256 6ee994483f43ec18691aaa73aeab6ced29364b1c2e5813ab19f46e1ac7ad6f10

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 dd652cda56435b610002c449a5efa3833680fe91b5e8faf3bf06bbc81a650ac2
MD5 e7ee0d774a1dc6ea41723fd3aac58091
BLAKE2b-256 8e682c21ac2a189fb0c7baf0b8f0b075ff5ebbc1de698f51a33e461a26d273ce

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 d84a1b7f2d45859576083e3a98a0a2b9d4060729fe6594be85034324fcdd7917
MD5 57439a2c99c2a47c51599bdb0301dcc7
BLAKE2b-256 970d62b3d25bb21b52ebfef02cccdd8be9b6848fe7c8437e56de34815e663c9b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 632e6b0bc809aca21ac3a509d6e09fa530134fa87470c6e245a1a768648c715a
MD5 a85b8c200815a3e85feb58eb325c58af
BLAKE2b-256 b26658a9ee6ee1851559d05ee632b6edc196bac747e37e9ad802475466f8527c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 788d482e2e9803e2c7b32eac9813f49de845cba8b94ea0c6779d5fa66c50c021
MD5 2065e6c1cb66c3d1fafa136e69745812
BLAKE2b-256 4360aaa0cb3eb95a1599fc8046bb8fa605dfe50b2db9238a2333f9da31330fe6

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 a528761e81176dcf0988a9aab0637fc4ba5cb44fdb65a164e4398930a97e2ec8
MD5 8690a6bd057a00e16dd53f4623391c9f
BLAKE2b-256 8676534767f3b5b3c4ff5db6fd886455e1e396841571848927ef437cc0f3fea4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 9cd21be1be2759aadb6c892d7f8873c284c5f26c0b0068aeeaeb5f38aca8d61e
MD5 e030f8e7fa6e7dd07a564faafb8ffd12
BLAKE2b-256 ab694b40ba4a9adb043a473eded7b14e5d3d108e5276129b951be483b09b07d5

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 19c4b4691131f8847214dcedb0cdd94da03af2aa11145b900f93445eb5d69781
MD5 4c68613156e49e2f468be3509feb1e0a
BLAKE2b-256 20203ded8a211dfac0e767eb66a66bec9b6e1471b0d0da0f15d412705454a1a0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 14036bab4488dda98fb00977b40b9ba217bc0b870882ae0e32c53bb6ec8fc64a
MD5 f1a4ba527348e9c624766a5989de91cb
BLAKE2b-256 bdfd5ebc1d3146149f8141dc0f4fec928087518be9aafa68294c32025f79d4f7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 cb721a38ec3742b54dc816d534272a8da05bbabffbb4b977716fb321a4b9a092
MD5 02372628935af2ea91ae54945aa1e1da
BLAKE2b-256 d707b3fc918a83574c37de0e27e4421fe024a758dbf6742f07505b608a9dfb3d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 64c15edfee9373492365a6a2e5e377df818de93eda6b24b3025d189ef0fd0bdf
MD5 ff8cd0de9b815749aa42df828e239ac6
BLAKE2b-256 63240959ba7870bf5ccd5a932c3be01a8f8f26c3da23b70ae08257ff2362d42f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 136383e6021ad60323a314141f41d70d43cc8953370d13ac601a1b11c0d0ffe4
MD5 2239cabb3fd1bf25a2184a68f9ef98a9
BLAKE2b-256 5b554ad2ed40ae1ef711f95626d68421f9cd5ccc3dbcae489ea18b4634c88158

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 9e3d270ac274258eb8d7ec3d46a283f921d6ea3697c1e39dbfc2453a8a87b9ae
MD5 9a50fffaad6c554f17d62a9b69f7a070
BLAKE2b-256 9be285cfbceee1cecf9534101e8a4eac28ae5c6e13ecabb2ba99261ad99a9b9e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 7848cfd94b7ca963bf47822de5375710d240c40453bf333739bb32d2386a7e12
MD5 99270f0576ffa717b42321010337ee5b
BLAKE2b-256 6e0b79763be599b567dc2070cc2445ac9a7498297f532a15e18b6b5b639e7780

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 0ed299d3446c4a6bf6e2fa37b0bda064df9c35d0722c5457f25a2a978693332b
MD5 43a5d162f2c9a715ed9917cf19332fb6
BLAKE2b-256 3e46d0bcdfb427002caa29478175ec542f2856d55a8ef4d1d5700a2d8187b08c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 85c5768ec2e5905158b07699e58e34e2675c74ab30d25de1f41a878bcde0b6a1
MD5 fa6be1a18b02c5fe1e35b0dbfa8b36cc
BLAKE2b-256 e032ab4855d012360aacce2700865f7817b05ac20b5bc9dcbdb46c17e5935198

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 42ce44e7acca699af4b64001c2fabdcf87406b231a598c964c724a1caf68c147
MD5 1e96ac240d8d91125196e38f232d64ac
BLAKE2b-256 5db85e45acb14c7f8a71690877f531a9a25ee2ec82f08e0824b7939eb19a7f12

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 cda3b186b14666bc438a2df867fe77054e2157fedb983b50ebede36531e9fed0
MD5 36b141f970fd7d0f733a6c22594952bf
BLAKE2b-256 9353fd2f267308f8b18a5266e4bbb5cb384c681aa1fcb852a6fedb06ad23b1f7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.2-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.2-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 938903f086cfb10732db98db7f45270a9e9fcb937921b85af35fe7cd2c018d02
MD5 281baef81a5ab41c59f2bd2b9d4f658b
BLAKE2b-256 49a2f10d0def322c74fc6e2b103b34fc65533e0a38e734afd90ecdd3c42ccd81

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.15.2 This release

20 files

0.15.1

20 files

0.15.0

20 files

0.14.1

20 files

0.14.0

20 files

0.13.2

16 files

0.13.1

16 files

0.13.0

16 files

0.12.2

20 files

0.12.1

20 files

0.12.0

20 files

0.11.4

18 files

0.11.3

18 files

0.11.2

18 files

0.11.1

18 files

0.11.0

18 files

0.10.0

18 files

0.9.2

18 files

0.9.1

18 files

0.9.0

18 files

0.8.3

18 files

0.8.2

18 files

0.8.1

18 files

0.8.0

18 files

0.7.1

18 files

0.7.0

18 files

Pre-release

0.7.0rc2

18 files

Pre-release

0.7.0rc1

18 files

0.6.0

18 files

Pre-release

0.6.0rc4

14 files

Pre-release

0.6.0rc3

14 files

Pre-release

0.6.0rc1

5 files

0.5.2

14 files

0.5.1

14 files

0.5.0

14 files

0.4.0

12 files

0.3.0

10 files

Pre-release

0.3.0rc2

10 files

Pre-release

0.3.0rc1

10 files

0.2.0

10 files

Pre-release

0.2.0rc7

10 files

Pre-release

0.2.0rc6

10 files

Pre-release

0.2.0rc5

10 files

Pre-release

0.2.0rc4

10 files

Pre-release

0.2.0rc3

10 files

Pre-release

0.2.0rc2

10 files

Pre-release

0.2.0rc1

10 files

0.1.0

10 files

Pre-release

0.1.0rc4

10 files

Pre-release

0.1.0rc3

10 files

Pre-release

0.1.0rc2

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page