Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.12.1-cp314-cp314-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.12.1-cp314-cp314-win_amd64.whl (26.3 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.12.1-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.12.1-cp313-cp313-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.12.1-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.12.1-cp312-cp312-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.12.1-cp311-cp311-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.12.1-cp311-cp311-win_amd64.whl (26.2 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 8b01197ecaad0da9de3a8f1c7af77b6088c158588121977575a8f71ac1fd7cfb
MD5 d9ee2e81b7b58b373f98090e56ea6708
BLAKE2b-256 4547f819190fc477c6864500a00ebf7d9a2eeafcfd38028a184dde2c099ff2f7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 c99f8bd2d3c53e16530cf4a2b8b22d217f5ee10f4592ad0045e2c2402ee47485
MD5 b6cfb7c546c3df2749654bf734e8d120
BLAKE2b-256 14c93a7c406003a1390ae51b6653caaf39c14132e919837835472de94bf449b0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 9f2b9ba71c08917a91eb90bc7d5548ab5418ddd1a00e0ca28eb68c6cf0d23804
MD5 be29c962677e93b0c437c5c3975e5807
BLAKE2b-256 1c393482e12ec13cda0f2748617b0cebf822de0159590f8a2098adc05fd51efc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 4ebed86e1e4addf7ebdf49561c2e92e20e834a47c5b72730f5df5652055923ab
MD5 e579a8c6370fc9b6ccd65828a9a99c69
BLAKE2b-256 e55eaf10d37cfc8ed9c96855f7459f01b244465efbed037c43998bc1ec5ce1fb

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 214fbe082904fe4f415d91661aff2ac1dffd58a0245b23b65518397c7a010ebf
MD5 d961509ed9eadbbf6e8c1aa0bd2620b8
BLAKE2b-256 9fa704d85213490556e229767de622566fea530aaec392442ffd20015a75461f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 324058441eabeeb67579ba51cd29d35909941cee51473b7e029bd4cbbbe19879
MD5 fe8a2a7cde65ed429f9467962da4c14e
BLAKE2b-256 fa41104f6aaa04a6d3cde4f789b143ef62caa94ed80a665925364c788bbecf35

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 65c924c47b9d916c444b3e91f0c6cdecd481dbb36ee7e440daa83ba2f29eec79
MD5 a34101044ae91310adfb48d2a57cc11b
BLAKE2b-256 a10a6c57375c6dff392341f35fe3ed7518128e532594d78065a2efe1459174bf

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.12.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.12.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 46e5d4713676ae75c2b272ac1c53f17c7764aaac3bfa52f04bf62872171fcd3a
MD5 8e96ec7417142dbb8472ee41c18df7a3
BLAKE2b-256 3bfdae71311ea45a383de8bc8b1eb47334cf5ba999650dcaa53dc92bd35aa68c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page