Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.12.2-cp314-cp314-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.12.2-cp314-cp314-win_amd64.whl (26.4 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.12.2-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.12.2-cp313-cp313-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.12.2-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.12.2-cp312-cp312-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.12.2-cp311-cp311-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.12.2-cp311-cp311-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 3432b626ab4625543fb3c6c0588bf2611f53e73caa23043096d262fdcb7a70cb
MD5 5d2871e0e5b11fc287b4fbd313542033
BLAKE2b-256 75c5a0bb5983e4480f447e756a57721b2f7d9b07c610e7413bfbdb27d455419d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 bd8c3e91952ec5242e6461d8b838bba8eeb5529a4f95eaca7465a1a56321d30f
MD5 f1dbec7afdb20ec6f6e0fc7a11c5bda2
BLAKE2b-256 d9fa6d83846073f353c5c05de0911e9d65f1b77c70c494575c67d415cc6978f4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 979e02aab1f20dbe3e5d59cd26fceb438a77f91e97624ee892c017881bed0f9b
MD5 a52773078641ecb23985f2c81031080e
BLAKE2b-256 09911b5902c7e7932e994815be295fe506c23b372dd2eeb80f0e1dae0e3e0dde

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 276166b5921702ddbfdfe3b5de1ec64c94b30c956a9ee313a8babc606de7b0f7
MD5 b7e4aafccd660b30cffea4e284b14379
BLAKE2b-256 43245f5b7ed0c57bc20be173c496fa784ad093a3119b3546ec6aa72eb9d11446

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 e8b3f0ee47781fec79e3bb8a6e85a0ecda5f52a8bebdbe57538595e36436a28d
MD5 d25b79cdf40f4131eaf02e8f46196e4e
BLAKE2b-256 5168de4925120e0b90d9653da1b74656d5f58870882d7ca7f82c5ca80624b4ca

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 1e7974aec6772c94387fc1c62e7c03360de37d36ecbbbf44106e8775deb8e6fc
MD5 65a36cba5cad0418468fc14c17495af9
BLAKE2b-256 b8f36acb857360e83340962a44c2f1e6a78f007ec93b949782d55b31ea6138a6

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 d34cc57fc32b9b7e8c3b92ee9fa4043ddb7cd14a7353088fcee8c342e36c377f
MD5 4a21d76136d6b5fc21f1754a91443766
BLAKE2b-256 afec317d9b99e039bbce6514e360140b935335bb06fd646af278ccf368333d36

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 25285b20e63485740c82761ea049b04e6ab7f9a1cae49bf34069555e5ed88c4b
MD5 392df493781831dde4ed109f7edcf448
BLAKE2b-256 1c1e2011c312fe9e36859fab5a66c180c264d9fe0c1b9b9b85b9cca0b6dfe9d6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page