ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.15.2)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.15.0-cp314-cp314-win_arm64.whl (8.2 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.15.0-cp314-cp314-win_amd64.whl (27.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.15.0-cp313-cp313-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.15.0-cp313-cp313-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.15.0-cp312-cp312-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.15.0-cp312-cp312-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.15.0-cp311-cp311-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.15.0-cp311-cp311-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 bbff6b6ffb339c45d7ddcd1005d2cfde4515d2555e9fc63bfacffce3035a4eca
MD5 32e8e1dc3a7e40e488830d503b49c744
BLAKE2b-256 310089346349b2ce97e2d2e460eef552fb07ff600826c8b52468150019055a5d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 6819d8c9a9ad964befa435de7ec0093ba6bd5ffc636963e1b196a4478ce55cb4
MD5 1ae4c0fd77a5a165ed15f3e75c12ea74
BLAKE2b-256 edcce8394c8b7e0a6f77667ee29479a007909f2339ff501373bf33df5c6dd686

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 4d72b4ffc5949896eff425032beade2bd1ef4d28b74879899071423247cab19f
MD5 20920e02ff097d52f5b080024164dd98
BLAKE2b-256 dbbd7959e639922ecf38c422b1f1735f7fe3abfd4f29a74da40b9ee0b1187e37

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 7d25d73a2e5536bc67a757cd0cfbfb44554c61bbe7e48d7c96ac6f51e1b87370
MD5 2c22a8db0a0817ff4b18300f7217d247
BLAKE2b-256 041a5b42af75d913a1f2875210be5a34b46fec491659270f59174a1b70ad3dc2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 3f06aae2b719beee47df6e63a3136749f6e821ca06f704d0c9ef2a601e4fc695
MD5 5ab6438648be16a638116d98c1fa2546
BLAKE2b-256 ec3d5f8c66d9b6ee919a5c334bc5176ce8ca0d81fb43e3ae9b074c01c8b0289e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 520da120ee5b01d1e2d4b435d0fd1b96538b72675110e4b0f48d89580543ce51
MD5 d0c52f453bf511eb482b93f8173f2d4e
BLAKE2b-256 02c5b4beadab4809ef820c2cdfaf5ec92482f90d4c9973a1d873876e13ead195

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 519e58f686728437d6b7cbc305f9d2ced37a46245853bb35018d8fe2c4fa4f2f
MD5 2b0db3f4631b6d324174914354384ed4
BLAKE2b-256 e3640c60e1a76080aa49aa08f541ee7b7585a6b2139acb075969ba367327d3d9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 578f074403828fe3aa6311e1a9245cd31a37c41518d8795f2ee2ab6ba9ae4973
MD5 48729d8d9f4ef6858f88d5513f35e653
BLAKE2b-256 9f8d85dd458eb354eb7814122dfef3220daca5d44e0e87bd1f3064796a2bbed1

See more details on using hashes here.

Release history Release notifications | RSS feed

0.15.2

8 files

0.15.1

8 files

This release

0.15.0 This release

8 files

0.14.1

8 files

0.14.0

8 files

0.13.2

8 files

0.13.1

8 files

0.13.0

8 files

0.12.2

8 files

0.12.1

8 files

0.12.0

8 files

0.11.4

6 files

0.11.3

6 files

0.11.2

6 files

0.11.1

6 files

0.11.0

6 files

0.10.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page