ONNX Runtime GenAI

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta
Report project as malware

Project description

ONNX Runtime GenAI

Run SLMs/LLMs and multi-modal models on-device and in the cloud with ONNX Runtime.

For more details, see: docs https://onnxruntime.ai/docs/genai and repo: https://github.com/microsoft/onnxruntime-genai

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for microsoft from gravatar.com microsoft Avatar for natke from gravatar.com natke

Unverified details

These details have not been verified by PyPI
Meta

Release history Release notifications | RSS feed

This version

0.14.0

0.13.2

0.13.1

0.13.0

0.12.2

0.12.1

0.12.0

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.0

0.9.2

0.9.1

0.9.0

0.8.3

0.8.2

0.8.1

0.8.0

0.7.1

0.7.0

0.7.0rc2 pre-release

0.7.0rc1 pre-release

0.6.0

0.6.0rc4 pre-release

0.6.0rc3 pre-release

0.6.0rc1 pre-release

0.5.2

0.5.1

0.5.0

0.4.0

0.3.0

0.3.0rc2 pre-release

0.3.0rc1 pre-release

0.2.0

0.2.0rc7 pre-release

0.2.0rc6 pre-release

0.2.0rc5 pre-release

0.2.0rc4 pre-release

0.2.0rc3 pre-release

0.2.0rc2 pre-release

0.2.0rc1 pre-release

0.1.0

0.1.0rc4 pre-release

0.1.0rc3 pre-release

0.1.0rc2 pre-release

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

onnxruntime_genai-0.14.0-cp314-cp314-win_arm64.whl (2.8 MB view details)

Uploaded CPython 3.14Windows ARM64

onnxruntime_genai-0.14.0-cp314-cp314-win_amd64.whl (2.9 MB view details)

Uploaded CPython 3.14Windows x86-64

onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_x86_64.whl (58.8 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_aarch64.whl (58.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.0-cp314-cp314-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.14macOS 12.0+ ARM64

onnxruntime_genai-0.14.0-cp313-cp313-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows ARM64

onnxruntime_genai-0.14.0-cp313-cp313-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.13Windows x86-64

onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_x86_64.whl (58.9 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_aarch64.whl (58.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.0-cp313-cp313-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.13macOS 12.0+ ARM64

onnxruntime_genai-0.14.0-cp312-cp312-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows ARM64

onnxruntime_genai-0.14.0-cp312-cp312-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.12Windows x86-64

onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_x86_64.whl (58.9 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_aarch64.whl (58.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.0-cp312-cp312-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.12macOS 12.0+ ARM64

onnxruntime_genai-0.14.0-cp311-cp311-win_arm64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows ARM64

onnxruntime_genai-0.14.0-cp311-cp311-win_amd64.whl (2.7 MB view details)

Uploaded CPython 3.11Windows x86-64

onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_x86_64.whl (58.9 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ x86-64

onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_aarch64.whl (58.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

onnxruntime_genai-0.14.0-cp311-cp311-macosx_12_0_arm64.whl (3.8 MB view details)

Uploaded CPython 3.11macOS 12.0+ ARM64

File details

Details for the file onnxruntime_genai-0.14.0-cp314-cp314-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp314-cp314-win_arm64.whl
Algorithm Hash digest
SHA256 61d9bb9702452c8ae108e8419faa7aa657acf7ae6c64a56d80d1eb878a24d5b4
MD5 3062a47a3723de7cca0f3710cf969b55
BLAKE2b-256 d99ff330009fc5c5ad89dd56c2918b49614b87de03fa338cb0a55be2a06f4cd3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 3ed399c340b0b92bbf7ab8037121a4ed03fcba7494930f2a2d9f201f5d9ddde4
MD5 0d5fa4d8cb21d64d91dd925d1360bbc7
BLAKE2b-256 6c02878112760b76bdeb0fe9e0aeea5a07d883cdbb0a929e5900710179fb7863

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 9cecc61819d13409e653e31ce90727b4c44843ec0328a7ed277d9ce9e2ec4c1e
MD5 54a3c6817253e2e1694c752b4170ad0d
BLAKE2b-256 22beb3c2f96ab83a0ac4e1fb0ff924d2b7ab536d0a8ffaa9d3c0f63cc08da035

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 a73936ac118e223a19e1c4720411a492bc083cd542a4e5644ca8ea96937b3634
MD5 2e257c2f972e883a1ebb743257e4e2c0
BLAKE2b-256 0ff9e6e74d429290294278cc34397b83731506dcb0978cecc1b7c8a89cfd9005

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp314-cp314-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp314-cp314-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 35b544d762c974cf943f9b74edaaaa245922ce163fc05dd3fb96985f48cac47c
MD5 4c0e4d43674339396cd09580846c5a54
BLAKE2b-256 06a99df48178d459b26848c2b605ec6a252f25d61a9a3382d58c83cfd77114f0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 b9ab99997f74fe80a067c16c89448dde60f13405bb68b5a1af5e0c912ba7a76b
MD5 ed612208c16a2f8ce7a67710988ef12a
BLAKE2b-256 0d86e5dfce6421e916fbe3634a07772466935d6fce6fc10feaeacbc50979d276

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 4cb183809c0b10960f392ba308be3255751e51263cb4f605200f2c90610e0a89
MD5 59f804d00c9b68343b7c9e98af3312d5
BLAKE2b-256 3ad9cff8db2f062490552c57ef24bbc010657bfd3279543ba4dd2e065ba8b1dd

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 755c78b250f05bddd9271e5ccf6875212ce5e4999360c7af16a1220f4d997530
MD5 4b3773e94ff39b682581c8476ec85388
BLAKE2b-256 c8adedae83632028814a866dc3c79ff021bc85deed516206931f040fc4721d0e

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 5e631c7e0a0cbb9b4ac6795a9827ca606fa14a186208851459eccd926c7a7b77
MD5 3543df11f0d3bd9c4474e98b588c5958
BLAKE2b-256 cf12d2e60123bb39195a9938608dd42609a96ab431a3732588c0d92b2d99dc6a

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp313-cp313-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp313-cp313-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 b2b7e702fd1988139b5b7bca3038134c89273aff96a5acd37c5d91015f0f193e
MD5 8a658347a3a7ff835864a78ffb8c7007
BLAKE2b-256 019276a001e77b81d9e50502bbe0db0f3ead9afb7a9d72c2ef4a1bdd367a8162

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp312-cp312-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp312-cp312-win_arm64.whl
Algorithm Hash digest
SHA256 79206b4d7c2a642cff0402b4fc504f29e6a95dfccc9944094e55dbe99d90e10f
MD5 94cbe8d31d31547c24a9e53472746b5b
BLAKE2b-256 7ee2fee87df0ba8b4dcab7efae38134bbed602126bdebaf7d7bd5252f9d019c4

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 4461ee42af41ade58b07550465d689dff4932da5374cea892366261a4974c99d
MD5 a5a9c361ab773931a12f759689d3abaa
BLAKE2b-256 a2b15a5493c27e1426cf8f38349e94d34d2898638106109626e02794ffe4f676

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 6d391fd7e006c3f09c777b34c0467ecaeed1688ddecf931d487a771a74626ab2
MD5 2a36a1e9a4edb4e911eca8320d6e5d34
BLAKE2b-256 7b33983a3bfded30fc9b070586e510d1163c1387e9eef66eec9cbb8b0f174c2f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 e5136e2ec38b537c8c0cefa8ac5738fd007b9b5043b8da9420c6ac558126158e
MD5 cbdd3cab623113a4ddfe4b8db6a96ae0
BLAKE2b-256 7fe62f8d9171f5454ddf496bfc15e0d56ba2284e45223cec98050f783e4d528f

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp312-cp312-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp312-cp312-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 437a4cca506b0d9b1fc55f75afdac8440b9d10b23221f9d3aec94254b07234c6
MD5 3625a39c42032134345530a7c3baa8e9
BLAKE2b-256 512852b5bfcd74099a2ef0bc1d44b7833232b53542ece860ac8eadda551ad218

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp311-cp311-win_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp311-cp311-win_arm64.whl
Algorithm Hash digest
SHA256 46d4d93e700f0815ac6ca46996c56accda7147eb67de3ffe045c302492a255e7
MD5 b675ff4688da51965f9b7cb84b850d2f
BLAKE2b-256 af90a18dab60ddf4757b7901b5cf2a148b2c35bc5b4f9244844cdcb540b5d14b

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 a74a5265ac77d083668519fdb548dcdae8d335eab3bc9c45d71b6d5366fef076
MD5 9fa94062ae071e58189749bf39adc9cf
BLAKE2b-256 852546955f69743e68b61493980b2ed25ff6f566ba8f65d886aa6576c1a40f50

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 8ea891c64fb144c373f1464d0f539497bf17029806061946011d61bc31031ec8
MD5 8919db7783d30b686f36a6804b31a407
BLAKE2b-256 0572cbbc2f0cd32ea3541436dbf0752c46fb806aeb17925a774757e5ece9cbe3

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 1728ed0bd811a779b4b2e0e4819ae4b8c57ba113727a3cc61424bb4fd3ec9d58
MD5 26bf84821fb9eb794ba4a49fc3547048
BLAKE2b-256 2b7988ca9d794a81247dd02105bbade7f3884ca9f0bb42a6002f79e2912047e0

See more details on using hashes here.

File details

Details for the file onnxruntime_genai-0.14.0-cp311-cp311-macosx_12_0_arm64.whl.

File metadata

File hashes

Hashes for onnxruntime_genai-0.14.0-cp311-cp311-macosx_12_0_arm64.whl
Algorithm Hash digest
SHA256 7e136a86c252dfca8d7f7567943025d91a4303a89a77107924f338764e4b89ac
MD5 ceab60a7eb41a50769c602e92433425e
BLAKE2b-256 1a063497f93dcfb5abafd0aa7008336f1f4869a96eab4fa1d657d7dfaa7241ab

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page