Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.14.1-cp314-cp314-win_arm64.whl (3.8 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.14.1-cp314-cp314-win_amd64.whl (30.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.14.1-cp313-cp313-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.14.1-cp313-cp313-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.14.1-cp312-cp312-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.14.1-cp312-cp312-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.14.1-cp311-cp311-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.14.1-cp311-cp311-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 b3a7e2f545e4754f7e10efa0c3541103b5ace290158508df715b4a9ef935b5cf
MD5 debc4c91b0787996a9ba59772216f450
BLAKE2b-256 19daf6cbe0f10a39276ac176949131d5a06f4bf6108373856b7d3f9860d34172

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 0f76feeb93d9ffc3d9fa97ee646403a32e8c9c6a6575d6e105b3ca82733cb48f
MD5 d8e80c412981b965965730b7f1cb0440
BLAKE2b-256 9aa62f653623143138ec9d6f6d07e2057b32baa50ea4306c4efcf3d92be34344

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 d3982855bd1b4b398d4c53c07d2e4c76f86779f88744771d8be15b456ccbf5c1
MD5 ea284cf4f72aad66db444a441d1fe78f
BLAKE2b-256 08d8886e3bc7eabe411615a654212f7d8672ce0b27520b787555a91459db964e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 f4f70156451747e5a6c775959ac6efa547f1233e32729d745aa1948f517f9516
MD5 9bbdbe10c520dbe3ca0cb022d06bb8b4
BLAKE2b-256 dd267a9e89c613f103139c8eda4f366c3c53c270f66c208906ec7c80afb551a2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 257a46ba948aaa3613daca69d5a077fce8a0e979bb6b2bb49228a170b81de04c
MD5 0cef6fc8cf3b52073089af118d513b43
BLAKE2b-256 403e455664fd48cd394098d978b8f9cb7845235585cd25274b909c703804ce5f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 cf44d1e178c9cca26c41c19450a2f4831cc154cf3c338e2737b04ba3a34a51b8
MD5 bd18caa65ec9f36830de249229e88164
BLAKE2b-256 090e750195584afd187fba2e97502c1a12b1312a720263bde15dbfcd2aa81212

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 f1ca23b0bb3b3cee5fcb7f680f0373b58144c7580514e59ebe322a9baec48f8a
MD5 008b58aa4157ebf1104426bd90719072
BLAKE2b-256 74705c121a1f0acb6e51f103abaab429bbfd05978a584dba3d3da3f6fae9d8f3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 79071ffa02edcb3f7aaee55f474c616807ffa8522329e09f3d358f9f3c8f8827
MD5 95e1d3663e5272d892554396a47d3465
BLAKE2b-256 0357bb3f6bd5b2670a2343a381116f40aa23a297d0590d58e0ca66dd16e4ac83

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page