ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.15.2)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_winml-0.15.1-cp314-cp314-win_arm64.whl (8.3 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_winml-0.15.1-cp314-cp314-win_amd64.whl (27.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_winml-0.15.1-cp313-cp313-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_winml-0.15.1-cp313-cp313-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_winml-0.15.1-cp312-cp312-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_winml-0.15.1-cp312-cp312-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_winml-0.15.1-cp311-cp311-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_winml-0.15.1-cp311-cp311-win_amd64.whl (27.3 MB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 480302ed11aaf883c3e4a9d732fdf3d3010a6497b2a5c8da2ce29ed7699fbd9f
MD5 31c0c81bd7b5ea90d73e9de9aeea2b63
BLAKE2b-256 fc4eb8f3fded73bceea595ffbe4fb65ed8f75b4167766e645f875a1fd2e52ea3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 7b0ceedd33cecb661b8178aa3b802fa52bcefce990e7191f86fd504388a2c8d6
MD5 52cc135546a291c08d3a3a34edeee219
BLAKE2b-256 768b3f1d142bff4156f8830c0272e38adac0c5cf8d35ab288e28ad333a970dc3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 cde78905418aac83f873489ce3f827d950092d179674188eeb0c2b86bfd60f0b
MD5 cc98ae8d712cf7c1b325097671fdd698
BLAKE2b-256 770d28339b3d2011c6a053ba48dda329a60db9c58932ce9ced2992637a7fbe06

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 e64dfc52b5610bd6a560438d89ad4b94f34248cd3d9df9c6ce44ff52ce2c95f0
MD5 4e231401082f4875fd12212befee3f46
BLAKE2b-256 66ac74cb374f7ce16e3ad8f18431be66e59d3aeee79bd6715870d3aef3df5d99

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 c966815b87d541466f42fa0e0b843328e19cbc177880e5fc29ccf19128919f04
MD5 e5e7979206649dd675bb4d6085c3c031
BLAKE2b-256 60138a2c059ed7454d92256f9ea7f673596a3e79e66b3d009d5223ef2b3a48f9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 e2d11305c1240ed98d356f5dbc2379f2d9ed7ac494f5fd534ce8fe191053d342
MD5 6e04b088376622729c874c558c7d1d13
BLAKE2b-256 9a147d4e8ace364d573601983f6186da6a225620b89c95b65d646940b46aecb2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 8facce86c240a9d7d8b82e664b8efae133ade02122f1283dd919eff3820df471
MD5 781def04db329ee00fcf3926ce5dd83e
BLAKE2b-256 961f27c8b2f605eb1c48125757517aebc2f940ff9a69a1c171e3dcc33bfa8c1e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_winml-0.15.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_winml-0.15.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 751a6cde044cb947df97ef011515fa35eacdfb572059f05bc92a0871dd54a7ce
MD5 d3ca63297be6e35f5092226ab7076559
BLAKE2b-256 a1b17ca209bd3b0a8fa0f567d1c2d52a1712616c09e0e92c8f0402fe9a87a727

See more details on using hashes here.

Release history Release notifications | RSS feed

0.15.2

8 files

This release

0.15.1 This release

8 files

0.15.0

8 files

0.14.1

8 files

0.14.0

8 files

0.13.2

8 files

0.13.1

8 files

0.13.0

8 files

0.12.2

8 files

0.12.1

8 files

0.12.0

8 files

0.11.4

6 files

0.11.3

6 files

0.11.2

6 files

0.11.1

6 files

0.11.0

6 files

0.10.0

6 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page