ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

This version

0.14.1

0.14.0

0.13.2

0.13.1

0.13.0

0.12.2

0.12.1

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.14.1-cp314-cp314-win_arm64.whl (2.8 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.14.1-cp314-cp314-win_amd64.whl (2.9 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_x86_64.whl (58.6 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_aarch64.whl (57.9 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.1-cp314-cp314-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.14.1-cp313-cp313-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.14.1-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_x86_64.whl (58.6 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_aarch64.whl (57.9 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.1-cp313-cp313-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.14.1-cp312-cp312-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.14.1-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl (58.6 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_aarch64.whl (57.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.1-cp312-cp312-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.14.1-cp311-cp311-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.14.1-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_x86_64.whl (58.6 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_aarch64.whl (58.0 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.1-cp311-cp311-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.14.1-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 1c22129aad2fb5a608a91ab389b02021db2d64bd044ec830df3cd97d3ad5b0ae
MD5 e6387d0c7dde3edd1e79fa08b4ac1d5c
BLAKE2b-256 a0601e0c1e9f484201491296ad92fac3900ec30bbeda4bdcc5f9ef810220bfd2

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 d63c8cf7e5734dfe627c2c036c76a149509a95bfca799317fc501c84d2a8191c
MD5 f311f5f7641a764d33f14a4a909297b2
BLAKE2b-256 7501c1d5bedda476940a329b3806c04241b11aa676cfeddbf78b70a581a40801

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 91729b9ec32aaa15db7556d5d95792732b5b45a3079f00a37fa86f7f74522c0c
MD5 63e85972a39aa24fdfca57ae079eb973
BLAKE2b-256 9eab55f7108f73fb16ad4601e6f69d126124750665adf72cc71e52f310832dd0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 4f605fa638959d10d67c0eeee065aa64f0c8096b56533485eea27fa977650e7f
MD5 69ae18c358a947e6b20b7506729a86a6
BLAKE2b-256 fb083df1ccce117af06147079f8eada0d7cfab1509d729b861f748831d2387b0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 89690dc5d642bb6ab25478aa88cad681cd465b1bde065e742f4b3e23fb42e3e1
MD5 8d57ac789260673978ec4474c52647ad
BLAKE2b-256 b93956243ceafc0fe4b376761ab5d36a66f575fe3539f82138440a66f390c502

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 57e0229d7506937222584897d5d714d9da24acec4a23337f301eb5a32d8b5162
MD5 a42df340fead3a4bc4d14ad60d24ae9a
BLAKE2b-256 bf26ae2090036e4f98673f16092544aeadb4268e9aea78ffe5bc5f6455c4864f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 022a3ac8dd2f3074c28299b52ce211366f439012c74e203d946a49773082791a
MD5 2f43dc5a4d1d640e155f0813d113beb0
BLAKE2b-256 83a167a29edee5c6203a0bd0b9e0e26f70145ff4745aa99694cd1a508eabe4ae

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 5a92c551772a6ccec15dbec7b05a4edf13514e5ad4de9321e16dba28897cb3b3
MD5 836691b147b1400615243f1051d756c1
BLAKE2b-256 b88072305fc33a8e472f6efbb3d918c792a3ce5b14bcf0ef9c2a4edd0d3c1431

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 55e4b9daf003408ead259bd4a2d018b5ddfdb54377e8edff27ed64b8af35cb15
MD5 264215620bf5e534be7673bdc91ff6c8
BLAKE2b-256 42c7d65fee722b5399c8f3028c2db2fde12901409c0f7bf8bab7b8ab631d2687

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 d9cbb344da8e17248fadd7ea7e6c6061c60ad9b16135b4ea0ecb82b70ca926af
MD5 9c28f561ce64a940f2cda96a84b097e2
BLAKE2b-256 badbc5a33b1d96446482234a3d74fb17652851fa27ec9fdcb2108d575895429d

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 624a657e19f3c02292daf832450fdbd540ed1c124c78b088e019ef31c7c5f70b
MD5 80207989631ace4d8965e56504c6ab5c
BLAKE2b-256 3cddc3fd09db178198950cfe12d599137f306ea72858c27001c5c8eb20108539

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 8387b9124f9bc9d179d747c61679cae084c3fd4ae1c061fd7714fac8f45f1f62
MD5 c59738bef63c1fd02935f23996ff9458
BLAKE2b-256 1dbeb1607f976d926a57bc59587cbb0d93342ef4e22ff36131d818f9a1fe5100

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 cd8b4e9dd59c389168c68e7144e4c0c1ed8f7784491150ab53f17db0f72259ed
MD5 a63a1438a60ea02e4782a22a525fce79
BLAKE2b-256 d371dc72d6301a5e2693689c33d1db214d5ce492bfd1320b7e018ba49900eab9

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 09053361be024625df60cdb1349a3287f3d51b312ad3e41d3473016acf7b1db8
MD5 9e59241ff0e9be8d3eccd8579bd1113d
BLAKE2b-256 fb3cd0c8938399f2ea13696ad85ad99a019f926edb683044eac0e3afd69bc18a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 c3a636ed7523ca9ead852ed183de1ed82eeba08e73e613f7f7ceb3a9f184b051
MD5 4bbf4b5111bc9527f3fde06d16cb9ce8
BLAKE2b-256 e6ae624358619fb0ab2c220589983b52d32ae5fd2631d7e22581cd0bc232ff74

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 42e51ce6469db477d05513afb0669386dbca8adcecff88e0c41840f147561806
MD5 86bcdc936dc7fce18e28ef53bd2dd07d
BLAKE2b-256 0325e7756ad05e81fbb333cb6c93050f8d49ab390194b0f777ff9d6c616883f5

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 79595bb8336c5b3bb7e753d4cd6c7f2682d74cb5d30975fb59cd448551d5a853
MD5 6d1afe8ecdde5c02bed0c66a23aded69
BLAKE2b-256 83ee9197abbbf981d0d7845d1ff0b1d8fdb8043073633ef52f84f910bcc8a7ce

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 cd8d6413124cca69c66f1dc347596a69f84e0cd5ad6dbd69de6ae524208990ac
MD5 07a3ad62dbd828cbbc6ad44fed141089
BLAKE2b-256 3654b2c1f59a01c99b91ed6f5bd77d0665ba2313a5dac617e23e905507d5226a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 bf8f8d05ff2d4b5eee7de98f3f3a0fb16d7db456bc37bf9cb72231b4e9645775
MD5 1bb8fd9b8c2affd652b8a94a2cf57d82
BLAKE2b-256 6499edb08bcade709157bcf1bfdbe624569aba8a69c0539065bd7dc303efc65f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.1-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.1-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 0a075530fc8b501cfcefc8c2ba13c17dc7ae74580f6369a7d1295ba7c5f6470b
MD5 8603e38547a6377bb2b8941bdf0c7a00
BLAKE2b-256 884cd7d6a6c6170d69c75c8ff59e7f8e8b0fafc7fda233af5625a761cf82928f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page