Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_directml_ryzenai-0.7.0.1-cp310-cp310-win_amd64.whl (2.3 MB view details)

Uploaded CPython 3.10Windows x86-64

File details

Details for the file onnxruntime_genai_directml_ryzenai-0.7.0.1-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_directml_ryzenai-0.7.0.1-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 87e58da988c663d8cd94a9141fe6016a83fa6b48208861566bcf377f4bcb7f4f
MD5 578c0532bbb5ec6dc87556bb797c2679
BLAKE2b-256 5fadf9fba5943246ba483f9cd89e979237c777c32f9f52360a59d87b7f762c32

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page