ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.15.2)

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.15.0-cp314-cp314-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.15.0-cp314-cp314-win_amd64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.0-cp314-cp314-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.15.0-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.15.0-cp313-cp313-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.0-cp313-cp313-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.15.0-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.15.0-cp312-cp312-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.0-cp312-cp312-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.15.0-cp311-cp311-win_arm64.whl (3.4 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.15.0-cp311-cp311-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.0-cp311-cp311-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.15.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 88573a8791553c73dd1c9e09d3082ebcb408d417602f5b0d84d53874d1cc5624
MD5 f2cb29123cb18e9be6816453be681d3f
BLAKE2b-256 8f41b57a9382e931157b03bde25e864fb511b09609c0aceef0244bf2d40002cc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 e96591c8c3864690a1dc7dfc4f50a1c624ff6f5a41a7c481620d8a2654637bef
MD5 178f94a12e7679cfbd33ac03db4be548
BLAKE2b-256 dedfa77f3f6d36bd04c63f6be0d6f9b482f62d4bb180c2b36dcca46cb5c0c7b1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 d3bcad1aa725a06bcf5e649842ad1d55e07bcaa9f20f970e7106e679a90d4f46
MD5 65279875a29be6e9bb15290dfd2ecf9b
BLAKE2b-256 265fc062d58b96c911e02cad1b194b8a23590801f0a9e2b5534e3cc42693c076

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 0960f9fd2b1551081e8c8254786c14d005ed6a144ba209bbfd312a4042f7b878
MD5 6341e6e10248e1c6996591f4154543ee
BLAKE2b-256 1ceb77887525c721a7f32ef868fefa02931c4033af79aff6a7185af6f145c871

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c4e7d92064d1cc2a7aa6fef70e867fb7188474cf6c5944833e13e1aa80f821ab
MD5 d66c8ee1a6d416997133d80e6867caa2
BLAKE2b-256 ced48a45d2c80fbaab16727fbe1a8cefcc1e664251238ae26f5469960c044bcc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 dcc8380ced8888d85b3bca16af747a621d0f3dea721c6dfe6c26f9530c29f164
MD5 a9b203cddefe1a36278f63565ed80bae
BLAKE2b-256 0ab8ad0a00c106aff4e337540ca7a8bd4c544a638df18b1005767944c6c56d9d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 838406632847b779de739bdd14451574308f0e16a7d0f7425621e150fde68252
MD5 b137dc84d8157b7a8b65b49c1ebd344a
BLAKE2b-256 610afc4f7e644dadcf2c8363356ace326cd79ba639ef2dbf147d5b1207ccf750

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 02ede24c96e007a27d4981fcf6c62141eedfb48e536e81e9166ad51afb0cd161
MD5 d5ae03f9ca928c857adf86a5d6c67b4f
BLAKE2b-256 73959e29e64f1d4e133c5d0100001a04a5b130e72058ea4249761f5ec7535ec9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 57da3de6c6ae1879447fb77434e604c0fe9413e5167b47673644e7dc9766eaa0
MD5 b8d59188f5a554ad4c97e59676d59340
BLAKE2b-256 556370c39d975ced22679c6240ae607a963de11eeb172910e518394d9f2b524f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 9f61fae2201b529bd26b01e7a0ef047929f76198425d3f675b6ef5d916f83835
MD5 731e8b3614c6b2fa3ad252951689e0e2
BLAKE2b-256 ca469ab5a07904b2e0295dbb7d3a99af20021392284306623329f7e05c7306cb

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 a27a9abd25ec4678c760ca01808e62f64aaaf412a02fe2729dd83494a586d6d7
MD5 bf8cd407fc36c8108a63893cec15811d
BLAKE2b-256 c66728bd7b31f1996946e433df8c6912948b0813b523837eb9fa53e8b730dc2b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 4ba853d4399b79ef8959e72b86ef7402e385ababb1b01f234d12c734ac2293f9
MD5 317285be2d6130368423cd4a6ba68782
BLAKE2b-256 084dd8c75ee1f7d9f91af62da370db9967bdbd00ca1038f448421cf5d3df1188

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 5a30a9a4b058c61f6809b881aaaa2116016eee210255e3b64a4746e95028959d
MD5 23f1a30fb7de683348f1f07befc21715
BLAKE2b-256 0813a9fbfbd564ab14432a81dee259806155a5b587a66e12d439e4a9e29c63ea

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 32ec7172b99d277fe0b889ab088973c45bde9238422eba1f5e9514450dc6a3d5
MD5 01f56b754a24549eeaa756fdffb88b9d
BLAKE2b-256 377045e1f5c9b0c869369d9e8f9c654b4455347800a73f4cb3538fdd1659055a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 88562136d4ee749fe73f8a197aea5928b277241c23015af151ba9a6ff36cbd7c
MD5 6253c3b9458e80741057cb4ab73c2d97
BLAKE2b-256 af09ca3c7816ae488e9615c014e1b551938b38184271ec49619f1e203963ae2a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 385d7b9fde44f02dadffe3783696f2d2017612135a00c33230858b6ad1361658
MD5 7caadcf801dabf905090e3bcc7c688ed
BLAKE2b-256 70072617449a9eaad388a1513eed7d752128ad78f4497ac0363bd6c7136fa6e7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 35bb620c95fec243272449aeca7f7f70c6a58cf2eed211d11f593946b100e41c
MD5 31abb56d0edf9dd7c8b8bee5a241f394
BLAKE2b-256 922e27d6e23488a5ea28666abeaaad9bbc07c13b31698b18346eaa5e0d55e080

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 eab37d394730c7f6e7e64865f0ec18d10acd4981d2bc87ae9e08d51ba58dd701
MD5 e5c21f465e41fd137d22b19881a29f40
BLAKE2b-256 154e78ce3eb0b44f3f532034d32d8478caf730b2008038acf3d22ad9d322adb3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 afc51eb4aaf7bb2c6c47e4f822b26cdf28b440b51e8f78901c3edcc9098abaff
MD5 ad820a59131d81143dc1f8349373e78e
BLAKE2b-256 6ad62257f8d76b3f7395fe3b166f86e6af53037dff57085b98920a6ecf6d0d40

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.0-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.0-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 b488958a31974af634bc75a06d638834dfc0c0d9cabd5c8dd05f9f203a821d7a
MD5 8d04c36d603121d326dda728623f15f8
BLAKE2b-256 ffe5ecf418e5506d640a0da033922121f16e50414b50958dd14e25bb814f95d3

See more details on using hashes here.

Release history Release notifications | RSS feed

0.15.2

20 files

0.15.1

20 files

This release

0.15.0 This release

20 files

0.14.1

20 files

0.14.0

20 files

0.13.2

16 files

0.13.1

16 files

0.13.0

16 files

0.12.2

20 files

0.12.1

20 files

0.12.0

20 files

0.11.4

18 files

0.11.3

18 files

0.11.2

18 files

0.11.1

18 files

0.11.0

18 files

0.10.0

18 files

0.9.2

18 files

0.9.1

18 files

0.9.0

18 files

0.8.3

18 files

0.8.2

18 files

0.8.1

18 files

0.8.0

18 files

0.7.1

18 files

0.7.0

18 files

Pre-release

0.7.0rc2

18 files

Pre-release

0.7.0rc1

18 files

0.6.0

18 files

Pre-release

0.6.0rc4

14 files

Pre-release

0.6.0rc3

14 files

Pre-release

0.6.0rc1

5 files

0.5.2

14 files

0.5.1

14 files

0.5.0

14 files

0.4.0

12 files

0.3.0

10 files

Pre-release

0.3.0rc2

10 files

Pre-release

0.3.0rc1

10 files

0.2.0

10 files

Pre-release

0.2.0rc7

10 files

Pre-release

0.2.0rc6

10 files

Pre-release

0.2.0rc5

10 files

Pre-release

0.2.0rc4

10 files

Pre-release

0.2.0rc3

10 files

Pre-release

0.2.0rc2

10 files

Pre-release

0.2.0rc1

10 files

0.1.0

10 files

Pre-release

0.1.0rc4

10 files

Pre-release

0.1.0rc3

10 files

Pre-release

0.1.0rc2

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page