ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

This version

0.13.1

0.13.0

0.12.2

0.12.1

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.13.1-cp314-cp314-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.13.1-cp314-cp314-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.13.1-cp314-cp314-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.1-cp314-cp314-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.13.1-cp313-cp313-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.13.1-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.13.1-cp313-cp313-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.1-cp313-cp313-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.13.1-cp312-cp312-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.13.1-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.13.1-cp312-cp312-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.1-cp312-cp312-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.13.1-cp311-cp311-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.13.1-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.13.1-cp311-cp311-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.1-cp311-cp311-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.13.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 cec1ade266d38f1cc1191c2c5cd80ee3473f14a8e6284d9fde78505527735609
MD5 9b5be73502c2d22d4729369076e0b632
BLAKE2b-256 77d5bc76e0c4720707530e57cf91dff6768bfaccbe3985bad84b3818fd9084ae

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 d4006903d13cf231df2c5b97f17f992c22b39579a742a3644269cf521c44d642
MD5 36e032fc11c283a0b849ae5b27f6ec2d
BLAKE2b-256 57e8994d9bed439d62114f459e5288972c02adac7b69d01ad8cbf43ccb7a7005

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 8e541e2f82c868da0c825bc4de99d8bc4fbcea13a1222d7dd2e98ab9467e81b9
MD5 c1465f8368ffc37a4ddb4dd31f8c4a72
BLAKE2b-256 fbbbc62f78b40f1ca2c7001d01ae752b2652d16c25d0e9071f2667e8678cf7db

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 0ea257ec6bd919041054ad8444765742344975eaadcfa013646e32246ce3c448
MD5 01a26da71fd0d8a9057b12f31b780a18
BLAKE2b-256 229185d46e016946565e8ae1c9295e70872d9aadb8256cd25ac8350694a57a35

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 7b696050beb496e3cc7eb32114a8b709003f27e83d3f1cdc2aafb4bc026ea536
MD5 3bc53c3909412939780451723f2748ca
BLAKE2b-256 7df69f7002f56caabd71df7349c72abf5e4851fd6ede99d1e4a79a2a0d6aa84d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 910ef7359f646553ef78d6d0069d99d9e2f3ee07cd971305e935109b7399189c
MD5 7b9893ff2d680bb5e23657037a352e66
BLAKE2b-256 96648547046d61c2f5d6c589b0be8e9178c31d149cb9c9e3af543227b583ba6e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6cfe0e191cfcf3385b5c32f81aee9cb090dfd1474473a1ce5bec0487a5f55563
MD5 8f993f2ee36ca494a20013228c4dd032
BLAKE2b-256 e32d967b1f6d991784fbc36ced1a296156e8789c7e8a16490b7817a4f9e8e7b9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 850b7e48a04513c08931c59c6d09cd3f88576a418fa1a43257d75924f9e36ae6
MD5 28dbff5ff83981debc945700b9b20b97
BLAKE2b-256 6307cfa5f7ec9657b37b73c0910f6c5e9b3780d761ba82baa0f83a68dd844f3b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 500f49567492b6175d0e81193b2fa232c4f8032ee32aa717dba5fb9cb5814b62
MD5 7e3503cc465053482695c14012dd5d90
BLAKE2b-256 9952d7e8a13cd5e215963f650674f4631c563f0dd8c94a51b1b05cf52a56e17b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f06f4073de46603106bb562f7e80a9f048e14fd28d2000b782040acf6f9c0684
MD5 65a964e2e8ef04b881ad44cf9bf1fd32
BLAKE2b-256 3a31e272114034038994014de653654c009a6087e7026b09c8fbe66af86d7f1c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 fc32dd12a1e5cccf8de91b9cbae20331ea2bc382f31217801ba30bc82234bb81
MD5 781e2621813f5bf4df2d8c4b6912ca79
BLAKE2b-256 913051356b0590b13ce9158ec9564d56eb0acb24ee7cc0b5e31e0a4c04b55306

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c3e6d4e95b16a2014d409ad8e6c52773ec28d99ec7a473ab5d47a6fe0b4287ca
MD5 34ef7a78181f27903b1f36e2d74d003d
BLAKE2b-256 6c20cfb80c54d90e1cdd37e44365684b6ff65da8ddb46fd64fa4f74c4a8fcbec

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 55fe0ae4786fbc13b269b1c85b5326992e3f5cf945a464f59a30ebe09584019c
MD5 7f5196635a899d0d0fd53508d4aa576c
BLAKE2b-256 272f51b619841517688fec0690406d43af950ad585cdec4e795e0262c751bf6d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 b96f82f0f61862680171b040b941a2a49d8a0cb843a07ab07983aa4e7d755b8c
MD5 d3a63f53f1502bb83ac16a02e0f6f57b
BLAKE2b-256 a987cf2dbfee0aa6a3012fc2ddd990bc944ef1ecae9e15a890c2934418dea635

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6c8fcaadbb265791e6c7e309327552b5f8749dadf764ea148d41b5f1170386ca
MD5 f4f05753aa7e0c2be45e11b007cb3c40
BLAKE2b-256 3ff09bb9ff955191bf1ff5da2a85d5a9f3d8c62c922998db3c3da25282e732de

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.1-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.1-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 2b61a767d90e58683a29503df1dae3cb8608ca7eff8e1bbb23fed9f6552fd794
MD5 9d5cb5f819b226955109f3ad92efd14e
BLAKE2b-256 09040510bc9e8e1c52e7e9e8d8aebcb18373895fd0ea09e306e8380de55ecbbe

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page