Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.14.0-cp314-cp314-win_arm64.whl (3.8 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.14.0-cp314-cp314-win_amd64.whl (30.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.14.0-cp313-cp313-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.14.0-cp313-cp313-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.14.0-cp312-cp312-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.14.0-cp312-cp312-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.14.0-cp311-cp311-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.14.0-cp311-cp311-win_amd64.whl (30.5 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 ea31da73a502a19242317f427aef842d0f9f258f3411c43acfa3b1390a975a34
MD5 3be296e945d6af3ffb219ee04cf2e3f9
BLAKE2b-256 e259f2ead5a4fc70516d72762d419e810975b748673e016bbefc8c07233df448

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 c303d7253b1c6da34680f716c37f4152722cd7ecb00aee4240c179dad4fbe7c8
MD5 5761fc5f34291afcdbc795f2de1d91d2
BLAKE2b-256 f14a7e26d426344b9c6db88cad3c0997e10708d925e27576653aedd2471a13c4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 b28fba242dd2070e2e60bb7e5a17b3075a48eb8f6f21cec4772952b197be9440
MD5 029cb883a5fcb925541ed522a57114d7
BLAKE2b-256 dc15298649dd3121c36b669a7a42228a8eec3f7351f8044f7d0dc28d7e1ac875

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 8265c5cb6a918f527462684093544f8943e8b24aadbe0553d2f977ca6c9841f1
MD5 fcbde4e6d4ce6d57ea86330232cbcd2e
BLAKE2b-256 09c4748e06337bd5f0664f6841e838dd017023acd1f4e033a272642119aa15bc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 897dd9c655981c09e277e835886985b66aed7d5945b83cfcdb39e5c4fe80258d
MD5 bace79396ff423f68bfcbcb69892fd9b
BLAKE2b-256 407f6976031892f2ec7ae83f43474354578f12ba05eea74a6e28dc25e1a23758

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 0fa6d1cb2bb2a36e72d7c464487054873638c9b198b2807c9ab810ec25f6e7fa
MD5 a8caab585900011adcde13d7230cd87b
BLAKE2b-256 ecd806763c213b8b889715eb43c36cdacbbfb52926d57da50936e8bbbd8f1dbd

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 0356d8dbdf8f44092bfb6c121a0fdbe7340ffff7ca00962bf06cc7691209a91b
MD5 2195fab25726164bdc82ccc45c11511c
BLAKE2b-256 b2064a4c78674ef8e1b9d3fc4fcf929cc69977a83b2cc29dce096cf6922ad8b4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.14.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.14.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 a610f8ad440aa2ff6f2a6917fee410583850b231bc11d863c9416315813ddaf8
MD5 e265342224b6d6cfe647b3d9471bcb14
BLAKE2b-256 d86b782674f34c0258ba42d001c8855d2af1b6d3da3e49030fb4120bec1f6de0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page