Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_directml-0.12.2-cp314-cp314-win_amd64.whl (3.9 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_directml-0.12.2-cp313-cp313-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_directml-0.12.2-cp312-cp312-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_directml-0.12.2-cp311-cp311-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_directml-0.12.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 30c5b7ff2c198a603ec4f01f2df80694078231d12c6284c6944b501073ddafee
MD5 5069d19f88453d6c5c51b77d20ff1beb
BLAKE2b-256 5e7daec26e22f6325f862b67fbaddadffdfec23a21e53fa47031dbf6878898b6

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 afd777c4c6af204b9b77732834f9a243355e96b297a60a132ab35c7548805109
MD5 11f792204b70bd4aba5050ddf71719df
BLAKE2b-256 21383836ff9fecb6eb5bd98888eeb545f6741b69524064919c587b7c1ebfc513

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f24dd3a7e1b8496d124bbaeed28b712a918e4e77d5139db33ead5fd3c9d94258
MD5 bcbdd2420f08926593954ab620a4fc52
BLAKE2b-256 1c949642b4f4ddfd8b7c8fca5d33d22b1677b0a3ad057e25a5d35f382529763d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 327f31dc3815ccb0d044d59a4e3e4326f10c6cadfde76cf2800da80eb4d63f01
MD5 2897a269266904a1de480299a2b0d3e4
BLAKE2b-256 00df6dfb9866f4f5bec5c4010145e569f02990bcb791d5398d8a5f37a2023400

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page