RKNN async inference Python bindings

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers
Report project as malware

Project description

ztu_somemodelruntime_ez_rknn_async

A better RKNPU2 python API

🚀 Feature Comparison

Feature This Project Official SDK
Model Loading & Basic Inference ✅ Supported ✅ Supported
Multi-core Tensor Parallel Inference ❌ Not Planned ✅ Supported
Multi-core Data Parallel Inference ✅ Supported ❌ Not Supported
Pipeline-based Async Inference ✅ Supported ⚠️ Limited (Depth = 1)
True Async Inference (Callback/Future) ✅ Supported ❌ Not Supported
Multi-batch Data Parallel Inference ✅ Supported ⚠️ Limited (Fixed batch/4D only)
Custom Operator Plugins ✅ Supported ❌ Not Supported
API Style 🚀 ORT-like (Easy migration) ⚙️ Proprietary (Complex)
Zero Dependencies ✅ Yes (NumPy only) ❌ No
Break Other Packages ✅ No ⚠️ Yes (https://github.com/airockchip/rknn-toolkit2/issues/414)
Open Source 🔓 Yes (AGPLv3) 🔒 No

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

0.8.4

0.8.3

0.8.2

0.8.1

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.2

0.5.2

0.5.0

0.4.0

0.3.2

This version

0.3.0

0.2.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (253.6 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (254.1 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (252.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (251.4 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (252.4 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (252.3 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 980c0d4dad4f6e9b673303a5053d075c38973bb183ee8de900d623f64faf6f7e
MD5 bf1deb9464512548d2f227f16dc02cd7
BLAKE2b-256 665f42b00935c811124a9bededd59d270f23a38e680695c8a9a7a31fb670a58c

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 501f8587a2b540cd4659bd425807748771166ca19fe7c6b78d55dac5d26c8f6e
MD5 ac69133957d594ef490194ee48f0617a
BLAKE2b-256 60e18c80b2e7d8fc4ab917b58a47a51a74a442c3c494f2e7de1b049dc41b9379

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 b95af06cad3f07c38ba9265e13e571b3e99d0e7e2ff6ac9d043431d059d30558
MD5 970483b2194b0e51ce161a77beb57cf6
BLAKE2b-256 f947f0616513f7502ae40393b16ec54bde37948fc90f6b01fb63687b9e37938c

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 9c051e90b18c39ca642a6025cf04f4a64f48808ac01d5f0b82c34167fa8ebe08
MD5 acba068e94cf2301b331aa5ef97ccdf0
BLAKE2b-256 b40ed077267166045b45b648b14624ea1b104d110836371c22b94c56e4eea615

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 8f9a0e5a2a7b45526753a01da81e3303e73677f4c744197fa638400986066276
MD5 1056289aaaa45f87381a7b99c839656e
BLAKE2b-256 6c30cdee9fb9709c3aef121a308e7e995f4bb74af19f97023d31c6af0fcfad24

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 e1a939d83283d9450f6dcbb4b44575ed9aba9d57bc34a8c5c54cb17574c3f916
MD5 39b32109d113f971559648dbf2e47191
BLAKE2b-256 9b325dec9732723d2d8c9418bbb9ddde798144389593fc700f6c59161ce03917

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page