ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

0.14.0

This version

0.13.2

0.13.1

0.13.0

0.12.2

0.12.1

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.13.2-cp314-cp314-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.13.2-cp314-cp314-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.13.2-cp314-cp314-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.2-cp314-cp314-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.13.2-cp313-cp313-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.13.2-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.13.2-cp313-cp313-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.2-cp313-cp313-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.13.2-cp312-cp312-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.13.2-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.13.2-cp312-cp312-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.2-cp312-cp312-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.13.2-cp311-cp311-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.13.2-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.13.2-cp311-cp311-manylinux_2_28_x86_64.whl (54.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.2-cp311-cp311-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.13.2-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 ff2485b1a35b06c070322f926ac511428792e54d730b001888aa169bf267da1d
MD5 76383602858aca2593d91e0fd4743735
BLAKE2b-256 b21f0c7a153e138d3ea5ad74d19c3b3532ecb9f8ed6a37ed04761ddf025ddc8d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 0aa469d5e0cab1fae36832597714cbbc3e03fde01a342e64ae45131d0e5331e2
MD5 0504fde030574022b15ad1b7e772c545
BLAKE2b-256 bdd32301b1285f6b9ff3ea808c0ec6345d115d0a78c5de131a383495173787d8

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 f4b9a01ffc62098537e6b838550383794aca54d8bb3487ba055b3b57c979d4eb
MD5 ed042e728f2f7117556f665a28d151ed
BLAKE2b-256 57b824c6e6522928e8008227c9a8ff3fc799593b351fe90801657baef78c69c3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 30cb5358ea55100e15b786418edf6ec7781a2a6b40dbec4e54da528587f84a34
MD5 ce0beff6172e2f23ee191039a7b79311
BLAKE2b-256 3d2e99fd4274800224b9154f1e459465e4193483a47897d6acb9b8560201c6e2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 efa538a540c1bb72cb7d8852d7ac6807bd1846f83c578de7898a2de782820347
MD5 ec750db433f7f3638a667303ce5c78d4
BLAKE2b-256 3fe4e5758ea02bafd79f3864425e5f0f025a41664f47fbbf17c32c5ee320b296

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 d89460ef25d547245daeab52a4e7063d0f73ea813efda226ada89f5449dc1db7
MD5 384eacd9f9db262fb10eb3374aaa0556
BLAKE2b-256 4638b2bb6fee6e1bb39150f348bdc579e0b583adeb78b7d063f8318c70243db7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 62a081a98f3a726d13d314d100f24aca45ef003765e8d3ebc99e9dce93c08d78
MD5 8caafe3ba89ee28930cb8ad03317f57c
BLAKE2b-256 accf18c57368aabcc687e30ec3a0e83a3470c7b336ffad3676c929fa380a94f5

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 43cf250dbcb326248fd0a13faacf0f49cc5f4e0ef8b816c5295b45dcca2635ef
MD5 3181f3260025e203f25c70c7b0c18f1b
BLAKE2b-256 a12a07ba09c96f1e4f94b5dca061d6d8e326d5449d3d43cab3ecaeac3f4386e2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 e2b56ca7bbeb150d6a0a2b92801a163104dc98597ee6615e4af4c45bc75cce3a
MD5 ced0c60e01cb0a4dc4092cfdabb031b7
BLAKE2b-256 93eef7d592f6015ad833abea00209b0d6421c964d49789f36f89e2281c8c1143

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 71e59e699e1aa3a247866235c274d8e749e5a7cc6f2be625ad2bcec750bd389c
MD5 fd9291779a219bb055b3588434b6f42b
BLAKE2b-256 6740ac4cd3cd6dcdc15b2d45cb4c6ec0e9cad7c5a844b2a5ae79df7398fbb4ab

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6a62c5a174b2a3d23c77e4f553fab297fa4adb0b34314b1e1f8d7b1f69e6071f
MD5 6fb0bc4712bafeb5cd55c25d3d2af2f6
BLAKE2b-256 17a238fa396af49abfd79331d731bd9d2cb819144a4eb7bca1badcd6412c0d5f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 b2b07932817b6525de8b5251093319e317d24382aee4579684649e46043b7f32
MD5 4a885a8877077c5b0a0ec94a168cd3d5
BLAKE2b-256 8410004fc011c19eebe66e8bb33becf1c90c03a978310a9b6f27271541187de9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 220eb4094ab5dc6243bfb7967cd84c81dc51dcd37cb52ea15ae07a3637ece50d
MD5 f058dc7a1ccd487638e9f3a34fde27e5
BLAKE2b-256 96bb7847203b2d4d2fb6d7b6cdecbd8dd8826e34eae9e8a5b466bc7938f40b1f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 31f565cc34517fcf2a7389f2ec845d109c7e5d9656a42ff5d5f8776ca2490acc
MD5 27172bd36d5ba98bb052443071ea5953
BLAKE2b-256 2e5fefe0fa2f3561fb3a1cdbf505b3c0f11864f3b385bbff293cb87958f35cc0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 815ab765875c0a0370fcfbaa556d1fc2b0a163ece594db14ef0b69a90211be51
MD5 bee76a26ede6996f578f57ce27e8598d
BLAKE2b-256 65f2aaa69a3c09b816f7b94ad999a8a191462de72f47d767ec967c2d58097cd0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.2-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.2-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c53249f82a4a5050aaf1a5913e7f243746efe359e1c8112ee2480abebd02746d
MD5 aba89e8689ab10029a2e3c1b07295a12
BLAKE2b-256 1814b49a08f9d48217fb53279212c948107d24c54e6ae40d98320986f4f776fc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page