Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.12.0-cp314-cp314-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.12.0-cp314-cp314-win_amd64.whl (26.3 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.12.0-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.12.0-cp313-cp313-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.12.0-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.12.0-cp312-cp312-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.12.0-cp311-cp311-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.12.0-cp311-cp311-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 098f18e4e9389f14166e5d6b9056d7d7d62166458b5e3e9211d1bc02cf6679b5
MD5 df9c465a3d517d02e901e63b53278530
BLAKE2b-256 d8e37c5aa87e21ae4138f59abb454a81fed12ab77996aea3c27ab08c07440801

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 272278d95d6f866d443638b9ee31b862f79c9c9ad65e9ce9067ee3158108a2e9
MD5 55f6fe1ec07a47867d943e169f287d4a
BLAKE2b-256 266c59d9e30c939d8dca6dfb69f86fb4bef8792811ee5d2ea0ad6f6918aadac8

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 540479d9534098137ed1c8c20732e92dedc61ff2593ca0c3897ddc84a70ce5c8
MD5 1c551b76ea693fa877b940b3f6973da6
BLAKE2b-256 bfbcbedce3e444abdcdb2191b81ea3cffdbb7c6d8baa5581feb261c7c4b458be

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 876b5069d8ee9d1c3b337ddd00d183a7a123d04c74719e0f26b66ab3e541d682
MD5 a56346ef7f5510355047a2716bbfd2cf
BLAKE2b-256 3d1742976b0413b234b809400e1c973636bbb24039e6fe7a5493accbf81466d1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 c0638c115b9608a47804b6c19b43e3913d1513e1225c23efb175f3f4920bdc30
MD5 11580a1d266e1814719b0118eaeec526
BLAKE2b-256 0647de924ab948bf54242cad43e167cb20f4f49790d0c544e51b63127afc15dc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 7571ea0b5bdffb3e6700939c2019ba80f7e81dfbfa2658040659632adf9637c5
MD5 7f4472c63064ddcfc6a4df0eaf6bcc05
BLAKE2b-256 cc1240ca9a8ade46cb091da3e3258c67b8c3528dd70ee7e18d2ca154dd3c2b69

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 1ea4ca3e6d58de03c6407040d076c87673569414c3613e3b6c8e46316e2001ac
MD5 61380e1d68ea33f3c2e4a987bb7f09cf
BLAKE2b-256 3ab084512ad556cf56492cf895d4c891db25adb1e3c7284db62d6f0ebac31e45

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3abbaec1c750d7b0e8eefadfd7e3a7e86fc971e7109724f75463448ac43445b8
MD5 e9c1e01151da9ece3a71b9d6487c3ec3
BLAKE2b-256 d31a33aedd5a6b707c5d6445b93e13aaed455467222ecda2fd0886f5d094830e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page