Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_directml-0.12.1-cp314-cp314-win_amd64.whl (3.9 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_directml-0.12.1-cp313-cp313-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_directml-0.12.1-cp312-cp312-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_directml-0.12.1-cp311-cp311-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_directml-0.12.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 60220c7b0f2d1dbb537c6ae14df086a9636e104bdff99a7f59e9080bfff7c182
MD5 76b2b05f504209e9320bf8e610beb8ae
BLAKE2b-256 369c7899f057f5e911033ac35e1c38eff24e67c4df316da69a3e55180288b08f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 82e93cae98a77b0f3f12a6f02d0415759a1ccbfa7c0db15b5a52234d9ea23cad
MD5 77ded2c2917b68aac768277384b73661
BLAKE2b-256 8876b9b392595890c23ea4a008189b835843b9cde7c72d8cefb388dffcf8bdeb

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 f8b967e5d5542c3883044c98202e4af6dc57afb95df4be5495bb60d3554ffebe
MD5 fca3845dac0644047387b10f11dd8283
BLAKE2b-256 672fa841f81df7c501a3a0d47e1e23496c8c21927324348f30ff0de089ebfe82

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.12.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.12.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 5a4d4ee479fa7d65fa1f930367c99632585c8eedf470bf58b4f4d949e613e15c
MD5 9400eda73b56dae21fc833aeb84fcb8c
BLAKE2b-256 d8754bd3170f58814ca77de07a4ccc1b71ecc157b3cf6a2e6c0a802c48c34a36

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page