Skip to main content

ONNX Runtime GenAI

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.13.2-cp314-cp314-win_arm64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.13.2-cp314-cp314-win_amd64.whl (30.6 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.13.2-cp313-cp313-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.13.2-cp313-cp313-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.13.2-cp312-cp312-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.13.2-cp312-cp312-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.13.2-cp311-cp311-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.13.2-cp311-cp311-win_amd64.whl (30.4 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 e65440aa9f763d566517d303afb504b5f3aaca93deb2cd2c79d8a17b836c9d6d
MD5 f0c83371bb4ed69b889e51b1eada7d23
BLAKE2b-256 8b236d47f2a947652c7a94b83fe6bd08d46798b501d94e3e3fb4809f0451255b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 a41e9035fd6d8539c7129b73614a2f3e9247f9da00a4666ef482ce73a46d1414
MD5 6362aa4077f9e70ff8c8ef2444c8d97c
BLAKE2b-256 73f6f1cdbbc2de80c0e48843dd31011a5fd52d3ec8551d24c8e3c9fe08eca03c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 6b1db1c29f3e086dd3f6e7eb91e3a1a18f388ff8fc21e40db61b1520417cf319
MD5 2475391f153e02eff6d8e96268831530
BLAKE2b-256 78b2fcf8fc6c904b7ee31a2cf2643b49563bdff99e15bc512c256cfc788a8998

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 ecdad9eac41dd3cbe799af7e2e8c5ce8c8115b532c667265fa75bed83344eb53
MD5 88f7269502bc9ada68170f35eaaaef30
BLAKE2b-256 4606e2f860ac845d80a40a46f856330359012cbe4ac318df585a401a9ca03079

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 a60d0fe456938e019462fcd35f966a986195cd42afe77bb694669249e973c993
MD5 c41da08cc02ebfdccabdbf269f32267a
BLAKE2b-256 19a6aa1c42e0dc3e74b6340e339b69d02a090723f119a94c05daec04a74a8ee2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 e9225a4dcdbf056cfec19f9f8288c02630c4553150e86aa4e3ce24ef4ce6369c
MD5 179df92628be3d9dcbe16d98946c5873
BLAKE2b-256 65700cb9e9eb24b6a0f18f257249de49423f887fa55714d9f4e5f047bad8f79c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 7ce3d14e938aaa02ea02b17e251c793d68453c69c6c43d0bcd65a32f44971059
MD5 c3088ea6dab6a11643e4d1e1d4dd9bfa
BLAKE2b-256 892c0f99ef583896ec86e410132ac447c127430f9b974e642d6a8667bf8131e9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.13.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.13.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 cdb6779d8deb053a64a139d0b27ca2f4d7c8437e2c169d60d8508c04adb220c2
MD5 6721f4c8c45e46833e6b8d47c229e5df
BLAKE2b-256 743bbceba756d7ccb7a79d362867d1f272696968f10e2ab7f4d0953076653469

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page