Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_directml-0.13.2-cp314-cp314-win_amd64.whl (4.0 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_directml-0.13.2-cp313-cp313-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_directml-0.13.2-cp312-cp312-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_directml-0.13.2-cp311-cp311-win_amd64.whl (3.8 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_directml-0.13.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.13.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 9d7471049df82c66e10c5f756b0e7a478729ee576d500154815e245dbf914c2c
MD5 cfe791aa085eba5d2f2728bffafc79a2
BLAKE2b-256 91ca8aec0ea3cdbe978a5394c538141138653f907666615ffc2c9174a52fc9da

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.13.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.13.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 4ce665b84d838365b0bcf8da49bf8b5e11b55709f33bb8e93695eb88e496d1ab
MD5 92d0f1d19423a9078c86ca295e77767b
BLAKE2b-256 9a2e79e875c58485fbb8f47a5755503139f8301564e01f52d0e7274e6a3ecd12

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.13.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.13.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 8250e9033c951ae303ed255abfad6ac6091384d6afcaa82d1db5a46970d70eff
MD5 dba85076139a72fe04ac6fa6068aadc7
BLAKE2b-256 832d166a6d6ef4253b2b17a24dd805095f2436b9d06340503c662b0a5a8e4458

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_directml-0.13.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml-0.13.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 99a5ef959cbbfe26749f7b223840eba6257573ccfbd6b2c139a1d7049535ce1b
MD5 e3730d15f09d76c15cc216f2fd0208fe
BLAKE2b-256 7365aea3f2e7925d7dfe688fde19e4853f35b5ba09c5f5a5d24716264968da98

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page