ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.15.2)

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_arm64.whl (8.2 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_amd64.whl (10.5 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai_cuda-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl (18.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_amd64.whl (10.4 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai_cuda-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl (18.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_amd64.whl (10.4 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai_cuda-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl (18.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_arm64.whl (8.1 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_amd64.whl (10.4 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai_cuda-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl (18.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 761a0b6b53667b3ccc1f22cdc8a899a9ccc70416866cf3f04529c47596f2cb06
MD5 e0820c5ac7415dda28672bb5ac084e64
BLAKE2b-256 b0e3251bb567bc5eb6d93d2fa2a4b1a18d8efe11d96f86a8c02407e0b5f90efc

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 d1d5462ac07eb1aa2147421ce1663edd8f1ef87f39e220c1f6f9c5956314595f
MD5 a8f0a53de9da8ff0970ab83d2c1101d7
BLAKE2b-256 fce42174b02060b3a1cd788b6534b313c913955b747169eb3730e186ad3f3aac

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 73d1573f3ff67ad938f190ec739014aa4efde3e4c9289746e652d57d98a5b746
MD5 13a9b707bcebd9254675058e5489081e
BLAKE2b-256 f526f96a23fc9ddeaa5ddd2afb56da2fea3bc57b5f678a6ee33aee8933814bb1

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 b75f9fffeadb99054b367ca0e0b10398056415435b0109ce985d48068ec2e397
MD5 96623b13da42fc2c356d3a3d0140a426
BLAKE2b-256 eb252ffeaf0c2bb386c7c4f05116f1492c580e8dd2769800af0fe7476d807250

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 776603a22a6d3f6f4929ace264ae59a828b97ced5e9e53d3088e922c0e26a614
MD5 1ad29ade638cc27208982c7ad6abb8b5
BLAKE2b-256 5d290b677e8a8fcc1c1016ef9edee77828d2f8a0e26b6d0dd92bd3c60e5ee5bf

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 e954be46b50f593b279d50bc723a3c99c7e6b889b92d62d92436fabd10691ef9
MD5 931b65b9b94f69e5ad7c919d67fe890b
BLAKE2b-256 eae135e395d883c8430d706a704c636259c039a39440bb82f50d8114186d0fca

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 b6980d44c3d69b66eca1c0f3cb481eac553cefd695140ee451848abbf02a0896
MD5 39b652dc3efe6cdea29f5d6bb0da0f67
BLAKE2b-256 31f9e0a001bab9943d3ea9b5146c12008beb111d4f0c4d73fd477392fa7c7f10

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 bc72c73de3998f5eebea3413f9c2890b3126ab04c961b45b7e0f3a5e440cfe47
MD5 c2146c7c72a4fb72ef6b404b0d30643b
BLAKE2b-256 6746292c0df38d1a84a2fb237d63021a944148bb6bb090bdb68a904597808688

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 d75f797559c7289d7871a810de7211f23af9ff684f4d3055aaeeadb3999ab897
MD5 ef02f4f8712fad58e631016b06d5a5e2
BLAKE2b-256 11751f77c1e9b268431082a401dd878f26c975c714607b506ab13e95a4f3e090

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 08862de800c32336a4d902d67f51542a619ccde778fc3ff4f06b5c675ab5902a
MD5 93b5b0787cb64910347c503aeeab8e11
BLAKE2b-256 19bc552b4c15e69b8fcce812a36a81a01731a94ec4b50234db2a760602a5853c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 82b39a2d12a849db5ae7faa8e04f4706bea578e0702e132df8fe37d86ab19004
MD5 c3acb5442e9f7d0ad1187e2fd4fc974d
BLAKE2b-256 ce948c4869f5dfbd26f974372a158917ffe8401bb3ebc390c08c8d1ccfafb320

See more details on using hashes here.

File details

Details for the file onnxruntime_genai_cuda-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai_cuda-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 4202dda3d4a3d1c88fec112185a9c72a32cb51acd97d77c2c9323ed24896ada1
MD5 fa88dc0b72f263337563395c8cb807d5
BLAKE2b-256 fc086e9d58e7b240ced703f62eae6199c08df0060c5c0335abad1f60a50c4124

See more details on using hashes here.

Release history Release notifications | RSS feed

0.15.2

12 files

This release

0.15.1 This release

12 files

0.15.0

12 files

0.14.1

8 files

0.14.0

8 files

0.13.2

8 files

0.13.1

8 files

0.13.0

8 files

0.12.2

8 files

0.12.1

8 files

0.12.0

8 files

0.11.4

8 files

0.11.3

8 files

0.11.2

8 files

0.11.1

8 files

0.11.0

8 files

0.10.0

8 files

0.9.2

8 files

0.9.1

8 files

0.9.0

8 files

0.8.3

8 files

0.8.2

8 files

0.8.1

8 files

0.8.0

8 files

0.7.1

8 files

0.7.0

8 files

Pre-release

0.7.0rc2

8 files

Pre-release

0.7.0rc1

8 files

0.6.0

8 files

Pre-release

0.6.0rc4

6 files

Pre-release

0.6.0rc3

6 files

Pre-release

0.6.0rc1

6 files

0.5.2

6 files

0.5.1

6 files

0.5.0

6 files

0.4.0

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page