ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_arm64.whl (5.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_amd64.whl (8.0 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_cuda-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl (16.8 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_arm64.whl (5.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_amd64.whl (7.8 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_cuda-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl (16.8 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_arm64.whl (5.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_amd64.whl (7.8 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_cuda-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl (16.8 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_arm64.whl (5.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_amd64.whl (7.8 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai_cuda-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl (16.8 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 e59f40dccf87f193574d35e3d6366f3f01f9a46b72d249b1b11437a9f621b4cc
MD5 e75478fd227837fb4e40f99df5b354f4
BLAKE2b-256 382806359b41a36178bd790eee005d43bc0173bcaf16497da5c9078f43909c28

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 9f2dbab2e270e07433a3fe4a3800389b0ac85e52dab1eaa8f6d43319c6877873
MD5 a9a62a425aaf8c559042d48169bc8712
BLAKE2b-256 fc70ff33a6f64aa2f1a1e2843209ae7ff4344a64597836ded30de3fc3e524faf

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 15b433f12e9466a3da78b7bba0bafffd3a1c3150e7bf0745a0dd1bc93bffa35c
MD5 c1bd7829527c264c232d53f43f27de47
BLAKE2b-256 00804cc3edc78784afa8a55360da80273e98afb8bb741ce8c5741c8da8ec35c1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 d907d4ca92acded7b09b71ae5e926efd2165c78d62f7a39036b97840ba6a6bfa
MD5 74591d03ececf2b2c850de61133e2d51
BLAKE2b-256 ac1a284cb0683a363d51459c9ffd8c3da146e00733c0c148f3e859e188689e90

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 d2c7199322da3cf0a10b7340d271d9b9fb93c2f9d1d6b9d130ea4cdb75a64c62
MD5 955c63015c14939a0845e1138775485e
BLAKE2b-256 dbf4fe7993d09f9124cce7ef4d4d15067bdb4b409958ef4a7aeda36d807c3fa1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 efa8ec437ed4a3d1fa36790c8fd44560cf9434e119a185373e937998bddc7509
MD5 e5d38bb809784fb50a29193985148809
BLAKE2b-256 73f4b5efbfff46dd7b059621edb2b5b7bf7cc513f0c45c6d6697fe3bb6db5cb3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 0cdee858ca2796ab1beadbddc022aba32d3f5c74ce28c2a57c8a94bf57da7c36
MD5 ab50c9dbe35f746b322ce769810d7189
BLAKE2b-256 c744b94956ce3fa2cc9f1d970a897dd3738676e2879110d4939f0686900d5aaf

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 c387541cb693b112250285b4d875eb711129cf326b1087df793a0ac0c637c7d9
MD5 5b4061418750d80953fcff51713fe3bc
BLAKE2b-256 578879c129ff18ad634f87cd62ec4d822373573b3bcb587781294bb98a154edb

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 37b3a3777b97c82ff2fbe5c0736b8307df8ce6836390c264e4258e3d44b47218
MD5 420ffedfd54ed33a399c61314b1dd43d
BLAKE2b-256 a14276364c8c7be10de206dd21b4be554ecd5a0eaadfb9667e836c1caee4e484

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 984cb5573387e3ab196e85ff488b4d8a5b1b517b408d8da4e223e7a8b468d226
MD5 853eca4b313a3d5070a0ea862d3c59b5
BLAKE2b-256 cf71cc4054395e095c1e834980129274a1e515a04ed3cb54a0e9a50fb5841595

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 e0760ec2c73bb46c93de6c4358dcaf0d030308bc2cbaf06d5ccfcf5ae6071e54
MD5 8989b6efb729146b92cd8e468130de6e
BLAKE2b-256 6d2171d90126b8df2d9bd465c6ad0752469aaeff5415d722142cee6ff9b500a8

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.2-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 0322d321e180e627303b40b3303c4036b08836f83560a72acc4161b8547ac009
MD5 a71b8604c3fabc917bc63a2ddb230497
BLAKE2b-256 54155dc97f31f594d12440714b37431f9aa5244377f2f6780035c82df4473df8

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.15.2 This release

12 files

0.15.1

12 files

0.15.0

12 files

0.14.1

8 files

0.14.0

8 files

0.13.2

8 files

0.13.1

8 files

0.13.0

8 files

0.12.2

8 files

0.12.1

8 files

0.12.0

8 files

0.11.4

8 files

0.11.3

8 files

0.11.2

8 files

0.11.1

8 files

0.11.0

8 files

0.10.0

8 files

0.9.2

8 files

0.9.1

8 files

0.9.0

8 files

0.8.3

8 files

0.8.2

8 files

0.8.1

8 files

0.8.0

8 files

0.7.1

8 files

0.7.0

8 files

Pre-release

0.7.0rc2

8 files

Pre-release

0.7.0rc1

8 files

0.6.0

8 files

Pre-release

0.6.0rc4

6 files

Pre-release

0.6.0rc3

6 files

Pre-release

0.6.0rc1

6 files

0.5.2

6 files

0.5.1

6 files

0.5.0

6 files

0.4.0

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page