ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

0.13.1

This version

0.13.0

0.12.2

0.12.1

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.13.0-cp314-cp314-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.13.0-cp314-cp314-win_amd64.whl (2.8 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.13.0-cp314-cp314-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.0-cp314-cp314-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.13.0-cp313-cp313-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.13.0-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.13.0-cp313-cp313-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.0-cp313-cp313-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.13.0-cp312-cp312-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.13.0-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.0-cp312-cp312-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.13.0-cp311-cp311-win_arm64.whl (2.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.13.0-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.13.0-cp311-cp311-manylinux_2_28_x86_64.whl (54.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.13.0-cp311-cp311-macosx_12_0_arm64.whl (3.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.13.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 0a27bef77f945011ee792dde2390d9eb21672c5d3d0bf8a3d2e23ea63e85dccd
MD5 68db57730f2b70ed052e86982cf245f3
BLAKE2b-256 c2718650a6eb6990e1205d4d12da1292929cd052430eab5b3563162088208ffc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 ed3d1c9dbf5719e02cd8b70559fd5e78200e2785d089b0ee186a7525ae6b884f
MD5 eaece8324310f699082b8df8baeeba13
BLAKE2b-256 4654c14737c7be557b8b3cc4d4a43b72f79ff3063144f3ce2c8fbd1cc3ed4de2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 87a838443d9f0fd6520d5e9f6c55e55a689e5b86f703bce804135c77f9a344b0
MD5 f1ac99b158e49f00103b445372069929
BLAKE2b-256 467ebd396f4a3dff02942ec98b4f5aff1e18329cadf3bee78a4b4ed2eab1a740

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 afa52f68a6b36008562a762dd9f6b06d9fbaa706ff826c582492af1e65b99014
MD5 bc10204f90bee88b5817748c27c56981
BLAKE2b-256 f0d0c8a1dfcc64e2cfe4e4a5a45ab4c8301d4feb01a0fc2f2676962de286533a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 a05b8f049e24a4cba27878500d6db02e83d08916efb0bd5eb1b6014e180481cd
MD5 07d2785145b1e274e7932644e7684f49
BLAKE2b-256 0232b6c612b15bdebc2b3e97bb6e681ab98e122eb1c8d8c3f228c4d23a14b9fa

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 be4c1f893bd566f7db33a266fb874cc9c5a48d5e15055943f4dcebb7d1ad0723
MD5 8de68d21e7e3ec65e09e44a50c276475
BLAKE2b-256 6f1de8046bd65fdb4e69a1666dd3cc6ac60f3f5e09c9c5c394347ced3c6d1f86

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 5fbbccd243e23dbf5ec2be1dd06b21c7a6fcbbe459d14938b868f4a4e20c6e42
MD5 84b8c6cc1511951a3d990429682a7f50
BLAKE2b-256 dddf6348cc1cb4773110d5fd36080d69c0e34343b17a1c29bc6b0888874efcfa

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 1d1ba1618a68f1eed213e632c4b32d7008a83739f12f46e2af47ba97a58aab65
MD5 ec44b951428e13c21116e284ea911475
BLAKE2b-256 22813a7dcff18f576aaa3c8063982c172fd7b650483d3f6e379310e7ce1cee2b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 9b153b0362f25a9099383ce33d08dab7140781fdd0211fa95a73ec14d5be71c3
MD5 fcfe1778a9263a72a3a83ced264e123d
BLAKE2b-256 4b961b8a3fe35f48e47002603c7bc8dd6e578d04df7140253b1d0194eb8cc0cc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 dcc119986aa69f977a7de2a116873950cf01b45e7c72d7b93bfcdcf3cef62767
MD5 a5527cf3add1839605d763d41565d8f6
BLAKE2b-256 0b773cefced09b742fc67c0514d5353f8d14d47f667bd9a2ea971b9037037b7d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 dd49c153201fd539afff2d78cf1d95319d42fcde09b00af6ef87ffd3decdb1f0
MD5 cb0d3ef58e3ff56e05c32f9d478e104d
BLAKE2b-256 7c467d958644863d172012e9ec7724d0e8cadac7d4ee785e4943fce5b76952f4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 7fb669285b3823117b3393ba287cbd44b29fa64166e328a0dd7af9d73a62e3fe
MD5 6ceb6b24129015a667b5853c84038e35
BLAKE2b-256 ce442c3538e00bc2a4099f7523e27e8c1e3eedf994b4651c2660d0cf7d3e46a4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 1b4b589a56023a7378b805f2c0c07d81bf5caebdcc7ae66c7a5b163a21164030
MD5 4a2e4a41a94b9f1c760e73829e86d4b9
BLAKE2b-256 e58f08cf2bd915d2417a6b373532e2ac242dbcc80a5d2e04cbd728ca1c819ffc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 c601d5bec5e10d391a2a56e11091b6ba44d5ae137001769e9cf237f5fa8862e3
MD5 a437b9d458939c64043b3cff7471133f
BLAKE2b-256 22732c41eca9249a2aadd9dda188a9d754baa31714f282cf49b1bb27d19f423c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 21c323871ae8ac1cbc49ba43f33007a1a8ffa61b6377412f7d3047504a0d5442
MD5 89c93889d71334312ecc8fd5e1c8dbef
BLAKE2b-256 e938b959f4604c767d879862811016d50bd8575d76acccf2e5174c0657c69a1c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.13.0-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.13.0-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 3f2d799bdcd8b19602e57fae0de4472691aa4fad40774b585700646ded039432
MD5 2b99ed4eb72d9a86ab098714d1e92371
BLAKE2b-256 769a8904fc6fbd1418650ba32342eabd1d9e53e07f085314521544b8849c7358

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page