ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.15.2)

2 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Credits

Author: Microsoft Corporation

License

MIT License

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.15.1-cp314-cp314-win_arm64.whl (3.6 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.15.1-cp314-cp314-win_amd64.whl (3.7 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.1-cp314-cp314-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.15.1-cp313-cp313-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.15.1-cp313-cp313-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.1-cp313-cp313-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.15.1-cp312-cp312-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.15.1-cp312-cp312-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.1-cp312-cp312-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.15.1-cp311-cp311-win_arm64.whl (3.5 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.15.1-cp311-cp311-win_amd64.whl (3.6 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl (11.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_aarch64.whl (11.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.15.1-cp311-cp311-macosx_12_0_arm64.whl (4.7 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.15.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 075434a4e7d4ff96c67f3cc92218af89481dfd014c902894541ca2210faf3c0b
MD5 d29ec78fc4222c19a205381ec975f086
BLAKE2b-256 b7c714eafb0a76e5ef8755c67d20b604d164f8d56a12a43b2508f9da8af9beac

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 352459125eb450f1d00b9e170dd00b45143d263f9ac5e78560b4b46ce5572a3d
MD5 b29a74a41c388b59bb8af4cdd90e9aec
BLAKE2b-256 20a1bc359c7843d4b4d1217898d24782e5cf9ed46100b75fa68b2df442ff7405

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 0a36f79ea05a4bad5626f2f840e4646d3f018d67825c8d9dbffd79c966a7a76c
MD5 4034d57fb6bbf55560c9ad8530c8cd60
BLAKE2b-256 45b6b9fe6ab20f318cea17fe647d3d454abaa64db37497db389cd80424ae2cba

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 c9dbdfbf76d4bf4332e788ebe975c437da811f821622566c59c7dcb773ec6fe4
MD5 680cff836064207043a0ace9aad4f4ef
BLAKE2b-256 d0339c19b81259305d067ff3a4f88edb8771f3175315e74f1e57a06a5fb68996

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c06033f1634a3a1310f4795740c22c13f379a19aff1071e0d219bc98411fc8c3
MD5 40c24eeb85f9b78bc8d84f103b03ae04
BLAKE2b-256 559e011376f86f7417a4e28de2c9ef8c18d0cfd2b192c6c30d60153a9d225a76

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 100582f28e9f6eb094ed4dbe774b5338c3015cc88ac629bb26591efea044a587
MD5 f929d1e9560cf3d022d9d5540a59e9d2
BLAKE2b-256 ccf140bf5cb28a1327f612e61521f463b59e4c8de1f8d14ac59fb3eeaa698409

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 d1986b69b69ee477f969fe65771e611953e56e5c6a34dd83f588982d2d28e3ed
MD5 535db82de0e8d2d016c6fc49a134750e
BLAKE2b-256 b83637d68119a138c0c3035b915617d4f644f6843fd235cc10d4325cb2d63b3f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6726e273173e12f465ac78d4d03b6c897a387a968596c875c3a49cf67115f490
MD5 91a0cd4bc4a4bbea91a645ca5a19e0dd
BLAKE2b-256 877b599792ea7e24af20d0611f47e8a2713f32599996ef3e8acffab0b8ca56ef

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 ef3c6fb13a206c60cfa266cd45127757d04e00e0555a180024f58e85fcd71112
MD5 282c4ffc3452470a44acdcd6ab1ba559
BLAKE2b-256 d3310eb3b15bf356f2ef89380ad29fb58c70f4bb0a569ff2eef3fedb9e2b0de5

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 eb750ed9cd0b9dc17805a33e53c6ecdbcf0c31592ee3a393dcb95173383584b6
MD5 6ceb9cef1682182b416fa76264e9ac9a
BLAKE2b-256 8d1c68d44425954bfe45bcf30dd536aa3a6e53e10f658de77dca8082bd8cb67c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 328d198491773ea2a25994b143b57e72f3dd6ac5b9e59af2a4d3bcef36de6c71
MD5 8924d5134e79d2ff339cd6dc8842e1a0
BLAKE2b-256 e81a15f5269c70fff793ab8b479dfd255555a76c4e91fea3463ea2440cb7fbbd

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 dce5a3257698e3f744f3fc4139b053cda8aad3d4154068eedf628e81d47b7c4e
MD5 0e2297f68c00764cf1c17eb3ece0da4c
BLAKE2b-256 9753b54a9c1e8d8c3644272bc321944a7a9b239f8d28c128b3f3f83bb839e28a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 ca003d391abf213b09529565c0eb851f3a4a3bf0dc6af8f2cfa6f373f12f46f1
MD5 631d3ab7a092b75300042658a71a0e78
BLAKE2b-256 3282250111d09f1f91cc084cec3c5dd4c511b9edd3eb45695acad719b5aad192

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 1b89e10ce1f8c63769bc489594fdf1acff307269736bdb565175bcb79cf9b1ac
MD5 4af6a82b2b78761fd922ae23c835ef81
BLAKE2b-256 f084cc0a61d3fc3792b2a564ff2e6a0072f04a55347f0fb1c967aa83c5112078

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 d0b900a61907db371582678e2b0fc5753f146c0db59369ebf4c39f4fa996c118
MD5 2fc985924b366399a3796cddfa65fac9
BLAKE2b-256 a119a6cf163ea48d10e509f37241e826073adc6833fcff3b7fc86d88d9ba216f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 6754ed4189266774d4d0c97d1fb561788808a0c32c661d68440abe3dd8e7f72d
MD5 911cf73eca68787548d9c4b6ca93883b
BLAKE2b-256 daa2bc4e14772c40d419368ff2e8368dd23e068151274c4f279ac5fc95d65c2d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 044a5d93b94fa472486ba640063865dfe76f0d28b956ecbfd859e58f6a2e1da5
MD5 fefe512e3c5e11583a9e51333c07581b
BLAKE2b-256 3301d425f296d5359306ea101704b07a7c47c976bdbc646735bcd3242fd37800

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 31cdfba7fc9c6e578bfda12999a06bc9ab830fedd537a5e3ed3473b4e68f84f9
MD5 97fe3041389ebd9f2ddaf418d8587fde
BLAKE2b-256 e7bc1d907b089442f19064ae6a20803989f4be35154a47eca9eb80fc14086b37

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 ad94bf28f7a15962dcd5c0c1ffc371228d8efa0fc2237b9fdd4c7b19fa4c46d9
MD5 21b37987fc5905f4470df7561f7d0313
BLAKE2b-256 7bf793c8c08ee47dde93a092fef043fe5b1f65b2b3c49887350458450af1371c

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.15.1-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.15.1-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 3ff8f32890abbe76107d897b0484b9b6da834a48a8db2009de678799d0003943
MD5 85eab45a6ab61dfaac8b2bdfaeed5bd7
BLAKE2b-256 4551dac0492a2c5db0b7e4e5319181a6eea6a02e8cccc845edd2eb3519f5d892

See more details on using hashes here.

Release history Release notifications | RSS feed

0.15.2

20 files

This release

0.15.1 This release

20 files

0.15.0

20 files

0.14.1

20 files

0.14.0

20 files

0.13.2

16 files

0.13.1

16 files

0.13.0

16 files

0.12.2

20 files

0.12.1

20 files

0.12.0

20 files

0.11.4

18 files

0.11.3

18 files

0.11.2

18 files

0.11.1

18 files

0.11.0

18 files

0.10.0

18 files

0.9.2

18 files

0.9.1

18 files

0.9.0

18 files

0.8.3

18 files

0.8.2

18 files

0.8.1

18 files

0.8.0

18 files

0.7.1

18 files

0.7.0

18 files

Pre-release

0.7.0rc2

18 files

Pre-release

0.7.0rc1

18 files

0.6.0

18 files

Pre-release

0.6.0rc4

14 files

Pre-release

0.6.0rc3

14 files

Pre-release

0.6.0rc1

5 files

0.5.2

14 files

0.5.1

14 files

0.5.0

14 files

0.4.0

12 files

0.3.0

10 files

Pre-release

0.3.0rc2

10 files

Pre-release

0.3.0rc1

10 files

0.2.0

10 files

Pre-release

0.2.0rc7

10 files

Pre-release

0.2.0rc6

10 files

Pre-release

0.2.0rc5

10 files

Pre-release

0.2.0rc4

10 files

Pre-release

0.2.0rc3

10 files

Pre-release

0.2.0rc2

10 files

Pre-release

0.2.0rc1

10 files

0.1.0

10 files

Pre-release

0.1.0rc4

10 files

Pre-release

0.1.0rc3

10 files

Pre-release

0.1.0rc2

10 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page