Skip to main content

RKNN async inference Python bindings

Project description

ztu_somemodelruntime_ez_rknn_async

A better RKNPU2 python API

Supported Python versions: 3.7+


🚀 Feature Comparison

Feature This Project Official SDK
Model Loading & Basic Inference ✅ Supported ✅ Supported
Multi-core Tensor Parallel Inference ✅ Supported ✅ Supported
Multi-core Data Parallel Inference ✅ Supported ❌ Not Supported
Pipeline-based Async Inference ✅ Supported ⚠️ Limited (Depth = 1)
True Async Inference (Callback/Future) ✅ Supported ❌ Not Supported
Multi-batch Data Parallel Inference ✅ Supported ⚠️ Limited (Fixed batch/4D only)
Custom Operator Plugins ✅ Supported ❌ Not Supported
API Style 🚀 ORT-like (Easy migration) ⚙️ Proprietary (Complex)
Zero Dependencies ✅ Yes (NumPy only) ❌ No
Break Other Packages ✅ No ⚠️ Yes (https://github.com/airockchip/rknn-toolkit2/issues/414)
Open Source 🔓 Yes (AGPLv3) 🔒 No

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ztu_somemodelruntime_ez_rknn_async-0.5.2.tar.gz (6.9 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

ztu_somemodelruntime_ez_rknn_async-0.5.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (998.6 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (995.0 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (995.2 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (993.1 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ ARM64

ztu_somemodelruntime_ez_rknn_async-0.5.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (912.2 kB view details)

Uploaded CPython 3.7mmanylinux: glibc 2.17+ ARM64

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2.tar.gz.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2.tar.gz
Algorithm Hash digest
SHA256 56389f0683ad69632bff59fb7fff0d3ce20e3c344484c1129d1c643a99d54767
MD5 adebc8d2a4223deba13edba3edb79711
BLAKE2b-256 79e0b00686d6690ca5a484547ea2e4fffe70d8cc5d805091a1ec22836b8bcd37

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2.tar.gz:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 5b992ecf72dcefa38f1b761c111a0c9ef1513e796b1a1b737003058433b3f4bf
MD5 4eb4fb2f99c3558f06f6dd735db33040
BLAKE2b-256 d8162f0f31fc82b94abf1ed40edfd2d3f7a2e4998e04150c6c5b48b22e7ef9e4

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 8f29ea1f4e9ce599d039b7ace4714800fdbe0689f17ce298cec9c26c646c7c49
MD5 d68cb654566d9dfdcf5b32396d929091
BLAKE2b-256 8391768a4de91665eec66cf2ab21a95565317fd1d1fb2ea4ab77fbdfc83ad955

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 e8be35b70640a9d6e6635c594518e1caa4eb3acaf5f9e9d73dd202e57bb6c49d
MD5 f099bfe5151f866e0120f35bafa783a5
BLAKE2b-256 bf044f05b548d37d6740bf833b1810e897b9515666dbd8a6640fb88651ba7574

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d94e3854001ed8c484794d794862fbc1d1255f14fd7d21c028f487b36515a55f
MD5 093561456ad1768efab9c1b817985ed7
BLAKE2b-256 b22872476b7cd9e0eb63c44edc0b013e7b8906c065f5dc479b14f489f210caf6

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 758c5e8c9f1f202658fff1bed6d1bbe2f919c22d2bb4fb644297a6138ca86914
MD5 66158c19f9e00d5a03b3d5e262597d09
BLAKE2b-256 274ed4359c1f5d96edb4758500c95c6e42fd7c331dc4ba34d3494cf629be71f3

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 66367de8da19b8dd70bb39f1a8e9e2db54a68f0bcfe783555ecf2b29d6b21846
MD5 5222ef9fbad4154cd49d42bf038c4246
BLAKE2b-256 4ce8d397d872e398be23226f206d6a06b5f6e1380350fea4a51c5456c7b5c8b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file ztu_somemodelruntime_ez_rknn_async-0.5.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 23f8fca377ec66f91945eaf4acd6b9250de108268a1abbcf74f449a7c9099775
MD5 69422039aa9ec20b1b8cd72d8ca8615e
BLAKE2b-256 8b21eaacc6073369a49b0315d078a71d8e00057ad4ae546274d6bc10afcf6a72

See more details on using hashes here.

Provenance

The following attestation bundles were made for ztu_somemodelruntime_ez_rknn_async-0.5.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: release-wheels.yml on happyme531/ztu_somemodelruntime_ez_rknn_async

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page