RKNN async inference Python bindings

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers
Report project as malware

Project description

ztu_somemodelruntime_ez_rknn_async

A better RKNPU2 python API

🚀 Feature Comparison

Feature This Project Official SDK
Model Loading & Basic Inference ✅ Supported ✅ Supported
Multi-core Tensor Parallel Inference ❌ Not Planned ✅ Supported
Multi-core Data Parallel Inference ✅ Supported ❌ Not Supported
Pipeline-based Async Inference ✅ Supported ⚠️ Limited (Depth = 1)
True Async Inference (Callback/Future) ✅ Supported ❌ Not Supported
Multi-batch Data Parallel Inference ✅ Supported ⚠️ Limited (Fixed batch/4D only)
Custom Operator Plugins ✅ Supported ❌ Not Supported
API Style 🚀 ORT-like (Easy migration) ⚙️ Proprietary (Complex)
Zero Dependencies ✅ Yes (NumPy only) ❌ No
Break Other Packages ✅ No ⚠️ Yes (https://github.com/airockchip/rknn-toolkit2/issues/414)
Open Source 🔓 Yes (AGPLv3) 🔒 No

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

0.8.4

0.8.3

0.8.2

0.8.1

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.2

0.5.2

0.5.0

0.4.0

This version

0.3.2

0.3.0

0.2.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.3.2-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.5 MB view details)

Uploaded CPython 3.8manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 5dca8e7ec5ac9a469b6d862b2fc1e15f495ffe3346ad74080d2866ff696875c0
MD5 e64e9c4b1d72d8496c5c8370b8c5ef7f
BLAKE2b-256 f957bd25921067e421186d8f357c29264f4b0fbb476ea847b37785e0cc1d5b7b

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 367e8d81ed9afa1ef6f55dd7f8d0e261f76ef074b69a8c25955b2fcfcb944c41
MD5 dcea647a8554e563f7da55c3129b64f8
BLAKE2b-256 e4b794b566a78e50b458049f4608c15d54c0b87d1b6ae1107c02d32ae31a67a6

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 e7e994ef582e95a5b7fc6f0c10736cd176e1cd22e88dd1d93d1e3edd35f5bb75
MD5 2f96d03d928702a7d795fa62b6d52d16
BLAKE2b-256 1f2891ead6751e3ff21e99d9cb7a86aeff243978cd91a81bc865efcd6704393e

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 bcd65af6c7810a9ffc13ffac8543b63c398ed6e7430d72c9b00c7f0c144e0c8d
MD5 fb2dcaefc25c8b25773f19dfab99eae3
BLAKE2b-256 29d47fbbe787168e161eaf2fb944f2c00f63fa0eb8d320b70e215123990e7211

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 0d0c8bc03bf12512836c198699cf064997861ad725121f1ce272ab7cf9752e11
MD5 a51e24cc01501807f4c2a998f12e8b18
BLAKE2b-256 7562449d82330da28de328d8321a1850dad2f705c33935e2a7c053a867c62dc8

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.3.2-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 2f6db102c7e03f33b6c27b3ec63858bf5bd449bd7b51bcf9e4bc0fe85311d1cf
MD5 a3b375970ffe87a51059a69d8071cd61
BLAKE2b-256 d94c139d117c160be1af6c45810bd680de58bd434463c5f1399aeffef597fc15

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.3.2-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page