ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

This version

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.12.0-cp314-cp314-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.12.0-cp314-cp314-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.12.0-cp314-cp314-manylinux_2_28_x86_64.whl (50.6 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ x86-64

onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_arm64.whl (3.6 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.12.0-cp313-cp313-win_arm64.whl (2.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.12.0-cp313-cp313-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.12.0-cp313-cp313-manylinux_2_28_x86_64.whl (50.6 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ x86-64

onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_arm64.whl (3.6 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.12.0-cp312-cp312-win_arm64.whl (2.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.12.0-cp312-cp312-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.12.0-cp312-cp312-manylinux_2_28_x86_64.whl (50.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ x86-64

onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_arm64.whl (3.6 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.12.0-cp311-cp311-win_arm64.whl (2.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.12.0-cp311-cp311-win_amd64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.12.0-cp311-cp311-manylinux_2_28_x86_64.whl (50.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_x86_64.whl (3.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ x86-64

onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_arm64.whl (3.6 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.12.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 567ceca2ff694f511765fed82145a3c58b3ffdf13eadb3e165006dca0e661227
MD5 2d8f2fdcfbfb63630557559d58a4c649
BLAKE2b-256 949b5f66dfe55b7bbaca688294886e46f96edfd47c2ebddfd075f6a8ab22bd09

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 98d45ef73baf9eb6a59b0101245bdb03fed9c08651af150698be17215f88b13e
MD5 7524d7cefe146ed8b0df620a3791d4d4
BLAKE2b-256 7665c31948de5c81bc33217ce04de5de4d3eee40f978c4a307fa8f9dc67553c1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 d0424a3a2c731deb6d69fa7b3a7bdd56f14325a8870abe4abfad2f2d30cc86f4
MD5 8f5cc8568597e27f7c54ab2da2f8846c
BLAKE2b-256 cc159db84a8df91c65bd4b6d907b4b58062569d90e9d47ba13161faec1ec0580

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 06d0ebd5e7982a7e8811cce84a4231b1dea247daea450d76b6387d1469f81c41
MD5 430e62eb342aed92d65a311b9e31ecd6
BLAKE2b-256 2703ebfeb0fc7a22eab073f32e00e2f034ef26aaff1619380f4005c60ec81cc9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c202de0349f14aa4076018bdc0b718d3bd8893977994a8b90fa0950615a7039e
MD5 70da81eaa2f4c8ad91b23dd536f5d1c8
BLAKE2b-256 41feaa4a022f260964fda58e99b55709862178b9a6b4a563d2fcf6b425297fc7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 c858b9baaa1f63b23a3324a0549e9512feb78429a69e377c90386f77f0d19478
MD5 35631d38307669a75487cadb694ccd70
BLAKE2b-256 2ed38ffceafffb2a670ee67bf386915dbcf11075c52d0643b63ee68007bec878

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 5dec66a13f17f25e79cbe96336b825c6377e83db39542826e2771e5302d50bf9
MD5 32e6e61ef883d178d331a9e647d5567b
BLAKE2b-256 2f9ded5179270c599e2e24c846194a6a56e4713c39b93389d4f7ee3c750cd369

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 2b7f7f3cde3e97c0263df0b6f585450a827a4ccac044620fda8511b6ad0399b8
MD5 466511fcea3f3c8cf64c2621446f3af3
BLAKE2b-256 8f2018d8e5973578d4b1fca7df9b56b0fc186eff9936381530103adc65876103

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 5515fd469eccd54a07e7d989d48644061da6cc7f76ac64b04e3bd0c92b844892
MD5 a7bcc5160926ff95fc38712df1d2a437
BLAKE2b-256 e4c5ca7be520b3ec0c7df4d2b7395435563fd9ab97d4531c5b1d283d40ff8962

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 934c9a3e64ea40675ff9b8be10ab76a87af9cb02a216625a3999387b70495f2e
MD5 be578c193a68458b9af69c0b181d0be4
BLAKE2b-256 c0618d2ba6140e1e01e9fc67af38cd2fa8d4a7e3dd6370264757068835b24598

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 eb63e8ccb88cf6dfa7cd2bceb568e8a5a462f8a2949fa0be3de75533a02d722d
MD5 2026040b48703892a8d0a67972ef2088
BLAKE2b-256 e90524d7634ec2ed414d096d1ed6ce9c168e5c3d304c2355f9ec767c3227bb74

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 41ea5cd5d4de61f19b8ae527563c23a2088615c65fba489550dbfcbb1c74b7fe
MD5 bac15a05b08ca7c479f3b41259c0699d
BLAKE2b-256 7e3cc2734b0d85fcd0fe88b6e97de15d93bf250878602b1ed2023df75b4f4e6e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 252784f424c0b27c699dea451fb501e1516a71020998029ac49653537dcda234
MD5 2915e659422bb40789d595f121343de5
BLAKE2b-256 7fd2c18d946540187876045e14b55956e2aa2ee296b3c9a5fef05e65a79660e0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 79b1b72c2fe69b0be09b3ad15515226dfd91f6e44c14e91f718823ac45498de1
MD5 40872d9ebfe0169095b8023c4b9d2ba2
BLAKE2b-256 5be6f269a9a124c54404ac4221464237bafc04a7f6241145b3e4d3bf872578dd

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 42276b7e875ff2624ead8412bc7aca0c5739958b0b26799eeab513b0e96343bd
MD5 f6e83cd60141d2c1f46120fb29dd59f9
BLAKE2b-256 917b26e6b7399746d411be7661c566243542639fe042b051f88356fc92e99f1e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 9458cc19f4e96ec8ebfae99d8def193f2919fbd03034c7a82c6420da73d4dbfe
MD5 0b5e8da9154bf4cc6fbbba97ec384005
BLAKE2b-256 c4f807b74791b0729d2d8a6ff1ca756eaf1566b3ecd279ab5b5475d22566f728

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 d03e0841fbb5912c25ed1c1e35a7eaa89ebc4992fd3f3ae3f5206d7ec112bc29
MD5 a363cb0dd1805b258b494043d63760a2
BLAKE2b-256 93f20d830f5bdff29aca7ff3e5d97d9277940d35c9f07b1f0b5e783a2a3f0beb

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 66b1d2800b1ac39181acde84bf1767339cac66dc2c6656091eeaea4aee9836b8
MD5 b3eec78539f81a2489449b543f37320b
BLAKE2b-256 c9fc5d8fe5b7bf20eb601876528f3a08ba57bfec5a822ce29894b9ce6d778b4c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_x86_64.whl
Algorithm Hash digest
SHA256 5b11dc539382120da302a73bbca8c4006652474cd01a7746c923d0c71cddb9b0
MD5 ccea4c59d5f59bb87a2c249e2dc8cc3c
BLAKE2b-256 018bfacb16805c11c0cf55675540b8269ba8cf9c3a30ad8a7b41be9f16b38ed8

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.12.0-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 7330f6b91931ed19cc7ae1a86ca8870cd7e74149f69ff9e43e60da16dba51110
MD5 874ecbd7f6069db89e359b8feb7697a3
BLAKE2b-256 371c2e9fd52ecab43212790bcf3d9ea1dbd6aedfdfffe6cf77f3be84257a50e1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page