RKNN async inference Python bindings

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers
Report project as malware

Project description

ztu_somemodelruntime_ez_rknn_async

A better RKNPU2 python API

🚀 Feature Comparison

Feature This Project Official SDK
Model Loading & Basic Inference ✅ Supported ✅ Supported
Multi-core Tensor Parallel Inference ✅ Supported ✅ Supported
Multi-core Data Parallel Inference ✅ Supported ❌ Not Supported
Pipeline-based Async Inference ✅ Supported ⚠️ Limited (Depth = 1)
True Async Inference (Callback/Future) ✅ Supported ❌ Not Supported
Multi-batch Data Parallel Inference ✅ Supported ⚠️ Limited (Fixed batch/4D only)
Custom Operator Plugins ✅ Supported ❌ Not Supported
API Style 🚀 ORT-like (Easy migration) ⚙️ Proprietary (Complex)
Zero Dependencies ✅ Yes (NumPy only) ❌ No
Break Other Packages ✅ No ⚠️ Yes (https://github.com/airockchip/rknn-toolkit2/issues/414)
Open Source 🔓 Yes (AGPLv3) 🔒 No

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

0.8.4

0.8.3

0.8.2

0.8.1

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.2

0.5.2

This version

0.5.0

0.4.0

0.3.2

0.3.0

0.2.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (882.5 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (882.5 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (868.2 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (866.1 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (866.2 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (865.2 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 4ea29f0e391c4626ea0c1ab39f782b4ba5ce30f0eda3ab7858131b4d019dd1a7
MD5 4c72f92ebe9614a2b78193f10fa783d9
BLAKE2b-256 73064f96d4a3d89c8a900278991fc901856ff7b1d006ef09901a23f455549b11

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 3dca3389e3c94ac00ed730667148791b700bf6c5d859168a298b93f6be6dc0a6
MD5 5193174be2c3b8ae73f756417200e5f3
BLAKE2b-256 a97bd78a0f6f879822c2f5fb5b23a24e391bf6c1ca28fffc5a283418c446145e

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 a946ad54785ba70fb55b4debc8670b30fa07c7f8173612304de89fd7b5ca56da
MD5 49cdea3ae1a5a7d51bffff7927236e25
BLAKE2b-256 08148eb5267d8df56e284b64f364bfbc7993063bd7e7a91822e7749bee6f0cd8

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 492b81956c594051d09cd975d1ca2d66ff1c44a984a76272de3f550d5035828e
MD5 87c483be13c270b46ec7a4ff5d1d8a14
BLAKE2b-256 43bc66c0a3c754873fff3c2b9caf71efd62130b6b474b25640bb5b8de2d3d605

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 13b962e5fb260e46d73f4daf3497a3c327ee4dc59e1b4aee0de3ade0dbb79707
MD5 e1569d5f1f939b889b64692e97e76734
BLAKE2b-256 326a658395dad4333483a9aa6877d5d6591a6d3780e21f825aa0be015141ccb3

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 36a9770bc7d309003e2ad9ab310d5571436684ecaec0decb2c35bc247a6fc50f
MD5 9151b504f9c2496b453fde7225aef9e2
BLAKE2b-256 4c4f6440d6eba0d2f4c14e7c370e63f9ad7aaa1b1f2c0a3344fb1e5c2468f889

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page