Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.13.0-cp314-cp314-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.13.0-cp314-cp314-win_amd64.whl (30.6 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.13.0-cp313-cp313-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.13.0-cp313-cp313-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.13.0-cp312-cp312-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.13.0-cp312-cp312-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.13.0-cp311-cp311-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.13.0-cp311-cp311-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 897b9885cadb74c6b26611dfeeccab5e90f16456ddda0402f3663fd1a8561b4b
MD5 4992e2cf6c0d9466ea82a71ce4d4f761
BLAKE2b-256 6d39b64f04fdaf3509566e1b7b5ead0075bc5abfb37945a7083a11f6cd8cf621

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 1cd4436b6fdc9a134862ed0bae950e44a7aeddd8d83672d5dcfc859bd2bb2434
MD5 a75599ba75c017984834263949ff7d5d
BLAKE2b-256 b87504feea83ed839fddc85aa16f1cb6705be1e8a8a23d954904b45f9879db38

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 9d961d7c58fdc8308dfcec9c188eb81fb6bb4bb86ed989e620329c6d8f110290
MD5 bb467ce8cdb5ef3d61d45e083a5e3059
BLAKE2b-256 c7a3c83c237439edede914c73739f1c48013e65a624b0d9a96c4710d18b2ed00

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 7570fa5bafc89aa421e5a6201a37ea01051ccb27f783858bd50a2d1686e5c7b9
MD5 7a4539f7fc731838c41974b699fbe9cd
BLAKE2b-256 8db3cd978233995848866a42aa7e29d4483d1e6a7229623884742d1cec4de889

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 84a2828f0681f002786a72e57c92b03ba697e8b94e19b7060389e1a6ec8d08bd
MD5 16eaf460c20c924d46651a4e87f143c1
BLAKE2b-256 5662e03a429052e9749c7a989342ddb5eb40532b4c1fba5550b5d7f8f769d2e1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 776a375c4244ab8c9b4aa8d9e5798d03d03307636edeadad34747ea81e657a00
MD5 3eac7bfb2d5d63f4526206859adab8f3
BLAKE2b-256 36300c56ee93628d4cb37cb5475e71cac91d0504821861a2bb3d541b26e202e0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 4d27eafaf3762390d01781f28d7e69dbfd42c9cc07b7d371078b2aa14e2c9047
MD5 2dba1b0a4875ee65b303675cee8e102c
BLAKE2b-256 d4307020b24491b95be836f6c1139ecc8152dddfc5d686c6f272c2ef12c17263

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 3165f449c7acadc0e33b2f6e134a4108ef48afd5135437f63e9e0bfdfc9b4d64
MD5 021fc9887ff8ca2cc5ac75c716f1fced
BLAKE2b-256 0e9611b5658e9d0b3fd6894ae0dae2bce1778a875a9321e7078f9e817f814477

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page