Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.13.1-cp314-cp314-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.13.1-cp314-cp314-win_amd64.whl (30.6 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.13.1-cp313-cp313-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.13.1-cp313-cp313-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.13.1-cp312-cp312-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.13.1-cp312-cp312-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.13.1-cp311-cp311-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.13.1-cp311-cp311-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 e968b8f6b77a488601c2003ecc3da3ac099cc464a9729c7ed6192f4685202164
MD5 00cf6c117c2b73a12548789dda228c96
BLAKE2b-256 4c349aaa05e5bfce41af526a6c8640eca0e7629c289f9fcf08c8dc511b1fc382

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 1f5ae1ce96f77ee798b062d71433146abc5cad75a912d6cf8f8bc3fc40b48956
MD5 796d7b4410f6cffac77e8ec8d2a539d2
BLAKE2b-256 8d931cea742c269055c7a4f16426a5883f690474b6f2127feed377dab7fc9336

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 996c9e132a8b96bf4c59c09c1165043758f21692ad03fc285104a436f9c8995c
MD5 6e4855e43278acc474ec701c7ca93036
BLAKE2b-256 0f4292eee209331037a8cc6c0b7c021e25a60af20ed187733b62c82f92592d98

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 267c8177478351d38908f2a4533a37311615f4032aad7185d374adffd2ca157b
MD5 4c9b4589f294ff7efe20c0d7f2b5bd2b
BLAKE2b-256 823e252e725615caf28bd7c0a350319a5d23035d2c708c202bb4683cebd95b0f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 305f21a07ba92d657969a39fa946f7f8f3644435d4f68e9f80f8ebfcc6520253
MD5 60cff094f2c2d6f030f5e97c7d526459
BLAKE2b-256 7f0b9f1ab958cfd32767a8561ea879eb7ced1d536465b27c780a67a4b59fbd3d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 3c22386bab146d36c966ee1530b504dd441df9ba0107d0eb8aa2509e22dd3c3e
MD5 bd62187de2c250e2ab7839ce0fdd173d
BLAKE2b-256 834007dc77c5ccc1e74a5865fbe1046e6b1b2ddd2ba3bd687bf8a924557ae7c5

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 3861c531dbf5e356a70fdceffa7224260d45edbe86736b1a4ca9e59fbf22c39f
MD5 4fea0dc6d69c4e68d83dea48c6a7376f
BLAKE2b-256 a469a65251ca52a231cbd5747d6ab00b6e8e4f40445b3cc0d8fbade8df1c9df7

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 4c8d596762e0c8de3bd11d8cc012f723153a8e0536cead0b87eb833310946114
MD5 3612e1c4a1e54fa498266fc12720046a
BLAKE2b-256 56f22b6b2e86a0843e187d1dcb7fc4f8a06bd6530c0bb8551c3cf5be4b4f317c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page