RKNN async inference Python bindings

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers
Report project as malware

Project description

ztu_somemodelruntime_ez_rknn_async

A better RKNPU2 python API

🚀 Feature Comparison

Feature This Project Official SDK
Model Loading & Basic Inference ✅ Supported ✅ Supported
Multi-core Tensor Parallel Inference ❌ Not Planned ✅ Supported
Multi-core Data Parallel Inference ✅ Supported ❌ Not Supported
Pipeline-based Async Inference ✅ Supported ⚠️ Limited (Depth = 1)
True Async Inference (Callback/Future) ✅ Supported ❌ Not Supported
Multi-batch Data Parallel Inference ✅ Supported ⚠️ Limited (Fixed batch/4D only)
Custom Operator Plugins ✅ Supported ❌ Not Supported
API Style 🚀 ORT-like (Easy migration) ⚙️ Proprietary (Complex)
Zero Dependencies ✅ Yes (NumPy only) ❌ No
Break Other Packages ✅ No ⚠️ Yes (https://github.com/airockchip/rknn-toolkit2/issues/414)
Open Source 🔓 Yes (AGPLv3) 🔒 No

Project details

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for happyme5315 from gravatar.com happyme5315

Unverified details

These details have not been verified by PyPI
Meta
  • License: GNU Affero General Public License v3 (GNU AFFERO GENERAL PUBLIC LICENSE)
  • Author: hallo1
  • Requires: Python >=3.8
Classifiers

Release history Release notifications | RSS feed

0.8.4

0.8.3

0.8.2

0.8.1

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.2

0.5.2

0.5.0

This version

0.4.0

0.3.2

0.3.0

0.2.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.4.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl (2.7 MB view details)

Uploaded CPython 3.8manylinux: glibc 2.26+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 f2436ade834e0a4e2034f0b4817cefd55f07d5ced041234fc0a325445125256a
MD5 4590823ecc88d9ec1bb3aa9995e2af4c
BLAKE2b-256 7332a8ac6321a8223339c9097b685ce48d86ba8451a504b52c94b639af61b9f5

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp313-cp313-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 eaee0194f59d9372f3514d94927603f0d81069161ae8eec2f8d034bf54b6dbca
MD5 b1cc697be99409adfa3a9cea68f0b58d
BLAKE2b-256 ed17d5388eeb7eea32cbe9577fa82d900d6ec6ff259c721164e04d1100d777c7

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp312-cp312-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 8605ccee9f1e7c17d9e8eef06a903d18d0cb38e19980a669774dde3ed524b6e8
MD5 7ce42efdf80d460673a9e1419e07f44c
BLAKE2b-256 2d96d3a9e97797243c11e46730a286ee3b94bdd7c2ea4fd481ca1a687b0af0d9

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp311-cp311-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 b99c81932e674853d89ea54d7ae4e6f32ff5ea10d46a623a54c2d3be426f6f16
MD5 3d6f65850d86d3a21e123cca7cba2bdd
BLAKE2b-256 68b4ac415b8059e91d0faaa44519277340db8ab2d0b4e6b2a83c5cd0b0efecae

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp310-cp310-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 309527cdcc7ac8b8aeb171beb8e5a46fc0e57186e4a71e9f7833bff3eb597271
MD5 c6ae70fb4bb5bb9dd966d1a4f5cb0178
BLAKE2b-256 465d4755ff0856d8868545f15774494c084697753e8a03814dc9c45f8088acea

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp39-cp39-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.4.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 4e388053970a4f2803ff3143c0664c7980cb7a644788d4bd6b71c9ab5b8b5e0e
MD5 0dcfdc8442454e0bdd3a74d1d4229817
BLAKE2b-256 a2bf80c6e60eb12e9a9663b0e98248b26885e7c1552676fe836d868e773f4efc

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.4.0-cp38-cp38-manylinux_2_26_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page