Skip to main content

Mobilint SDK qb Runtime Library : qbruntime

qbruntime is runtime library for Mobilint NPU products. Runtime Library is required to run inference on Mobilint NPUs using precompiled or custom models.

IMPORTANT: Please refer to official documentation for installing driver before using runtime library.

Prerequisites

Currently, pip installation is limited to below Ubuntu environments. For other environment, please refer to official documentation.

  • Ubuntu: 20.04 / 22.04 / 24.04
  • Python: 3.8 / 3.9 / 3.10 / 3.11 / 3.12
  • numpy

Installation

You may install python runtime library with following command

pip install mobilint-qb-runtime

For C++ library installation or downloading library from mobilint distribution site, please refer to official documentation.

Inference process

Running inference on Mobilint's NPU using the qbruntime runtime library involves four essential steps:

  1. Initialize the NPU device.
  2. Load the compiled model (MXQ file).
  3. Upload model to the NPU device.
  4. Run inference with user input.

Step 1: Accelerator

The Accelerator object represents the NPU device to be used. It abstracts a single device identified by the number appended to the device name (e.g., /dev/aries0 -> acc1, /dev/aries2 -> acc2). If no specific number is provided, NPU device 0 is used by default.

acc = qbruntime.Accelerator(0)

Step 2: Model

The Model object represents a model contained in an MXQ file. Upon creation, it immediately reads the MXQ file and stores the relevant information.

model = qbruntime.Model(MXQ_FILE_PATH)

Step 3: Pass Model information to the Accelerator

Pass the information with the {doxylink}mobilint::Model::launch(Accelerator & acc) method of Model object. It then uses the Accelerator object to run inference using this model.

Step 4: Run inference using passed Model information and input data

Get the input data and run inference using the mobilint::Model::infer() method of Model object.

model = qbruntime.Model(MXQ_FILE_PATH)
result = model.infer([INPUT])

Inference Scenario

## Python example
import qbruntime

MXQ_PATH = "path/to/mxq.mxq"

acc = qbruntime.Accelerator()               ## Step 1
model = qbruntime.Model(MXQ_PATH)           ## Step 2
model.launch(acc)                           ## Step 3

## Some preprocessing for input data

result = model.infer(preprocessed_input)    ## Step 4

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

mobilint_qb_runtime-1.3.2-cp314-cp314-win_amd64.whl (984.7 kB view details)

Uploaded CPython 3.14Windows x86-64

mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.14manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp313-cp313-win_amd64.whl (957.4 kB view details)

Uploaded CPython 3.13Windows x86-64

mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp312-cp312-win_amd64.whl (957.5 kB view details)

Uploaded CPython 3.12Windows x86-64

mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp311-cp311-win_amd64.whl (956.1 kB view details)

Uploaded CPython 3.11Windows x86-64

mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp310-cp310-win_amd64.whl (955.6 kB view details)

Uploaded CPython 3.10Windows x86-64

mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp39-cp39-win_amd64.whl (947.4 kB view details)

Uploaded CPython 3.9Windows x86-64

mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.9manylinux: glibc 2.28+ ARM64

mobilint_qb_runtime-1.3.2-cp38-cp38-win_amd64.whl (955.6 kB view details)

Uploaded CPython 3.8Windows x86-64

mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_31_x86_64.whl (1.5 MB view details)

Uploaded CPython 3.8manylinux: glibc 2.31+ x86-64

mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_28_aarch64.whl (1.2 MB view details)

Uploaded CPython 3.8manylinux: glibc 2.28+ ARM64

File details

Details for the file mobilint_qb_runtime-1.3.2-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 1b16c0534f09bfc521c4e07f27bdb533181c40d4f5e049010170721b5b8070ef
MD5 f775cd3d7ee0b1840b28c75de88fdced
BLAKE2b-256 fa2a77ca4f3dd5004cb4d84d70c0828860c6b7bc1b3d926474a66745046f00e6

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 307c7420dfc2ff41d345591d7b18ac1014001937247fd076748930de3aeb57bb
MD5 5a3da89fc58ddb8654da1c54fe6608b0
BLAKE2b-256 77ed109bbcd17ebec6dbc93b8cc42a97d4edbac9afe2fba64d165e4195192f38

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp314-cp314-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 8ac2e6159633766fb2f038b17b51317041f37295b12ce0d2dac47645445def8d
MD5 299467431d7bd5a3c360b870860e2081
BLAKE2b-256 68bbcbb5596d7a550d1029312e5cd1fa4fafff7fdd2dd8f7cb2b20513c939c19

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp313-cp313-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 e800d884aa9c2ff5ab3008650dcf5612acf545578085e59568d27974be1d39ac
MD5 05ad1ed89cc5402ff4b0f64b2f0c3e3b
BLAKE2b-256 5221bcd5bfc3b5c1ae271918ee1c198ecd59d859f9b1cd07eb0b83ee65ed75b7

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 aeea00f0a8f90b08c4fc9960d1c42215a00002125aa6ccd49f98965dfaec3a41
MD5 6bb481987c3457906fed59cd0ee14788
BLAKE2b-256 a5d6323191433bb860b84105580b8c99e2d49d7b27947e3c014b09cebc0c4ee8

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp313-cp313-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 7fe4a93d9e43648e5f29e2c06f99c141a83da7d5af2d66dd647094b11685af41
MD5 d98a8e52484940702536ab0992296ae4
BLAKE2b-256 effb1d890c2a65ccf733adca80b410ba67b92205b68679e06822fab9de7eafb2

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 c72ff7301110299a2d0473538432e5040353632bbdb6c254e83f3b49a04e959b
MD5 a23b69749db09c7c906e735486acaf3f
BLAKE2b-256 39fb70715891d4e3cce9551cf2f6142a8c27abb08769ecfd19d88a67d1af9a7a

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 742f3bc81d03f09c86e6783b3d4d8466d56f4ef63ab7551f05725b7c86079ae3
MD5 ae1758ea3990e14c1059f3180c194f65
BLAKE2b-256 8ab9709ae9f9e26a13c78a885f79dcef8e4d2d211994f37f0cd01dfc21622198

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp312-cp312-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 ea5d75527811f2dfe4397d261e48a7272d678e7e3f125e8c01328d1d1fe1d534
MD5 881c2231f8567782a3c6359abc5ffd4d
BLAKE2b-256 9b73f6a56e68fb99640d0d9e6d06b1ef5f26a9191b5de46aa1fd27e26c76c5f0

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 57e615b527f6bab09ff81262a9a12e10466a4a510556dafe0c20e6893d2cb3b6
MD5 f554b356b1d5d564532958f40f32451a
BLAKE2b-256 a3d2d35ec38cebb100b1e6ced31a5feb224848fc77039fa273ea42612fd8c6a5

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 b9f1a17344ddc3dffa8454108f477e9d9f5a8bf95dc01bd5d011a731b724699d
MD5 c79d9aba33342db7f66beafe7d7a6f7d
BLAKE2b-256 667e63fc012607fa1c144301cbaf4dbad536b29686c3dbdda462703b5a4bb518

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp311-cp311-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 654eaf6a806dbae3af2dc86442b817f9368aca30921f6330b16b04b457aa8249
MD5 f98e8e3c01f502450c3b3bfcfb4e67a8
BLAKE2b-256 a93bc2050d670e31a7cb65c905a4d160b59525f06c9a1acbe85e699122d62a35

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 42740dbca79408e472b980b7bd0bb4cacc55b10ba778f97c03a22eecf06e7ad7
MD5 5f25b1df5a262747e58bac93f85932d2
BLAKE2b-256 4d8566afa33eb96d4d8dcda1aab52af6cefc7e6c3a458fcb74c56989d95f8e1b

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 05c67394fef266b604c8f113c7707da7091720a4c61c2feb18f1e2eeeb5defb0
MD5 5dd57875ef71c9a44284c329f5ba2758
BLAKE2b-256 190815cad0d7c21a2dcaac6fa964420b329845bf1503948c236d4cee78a696b6

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp310-cp310-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 1e87294bb360d766b3d4f41849e05e5dea60cf9f63c2d3632e3174522cd3ec2c
MD5 b91edfc7a8831fa33fd73f260ed76ec2
BLAKE2b-256 9e078719b1cb5f6710053627d790fd799c00225c4a27fe2eac38ec3cd9ad317f

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp39-cp39-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 11b7a48b5bef646a846d59712be85af24d02267c760a43bf4946a217ffd42290
MD5 b0463626d6baaac9bcf1f429dbe902c4
BLAKE2b-256 4c5d78dd41ea6090d95f66586643cb2e40086e2f3aafc023cc9e3e91b5e70feb

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 dcda98872f193001648bc3f46f40cb09c8438eae0078da476962aadcea0cdb55
MD5 c94dc15cf9262f6e8e6319bd42a983f9
BLAKE2b-256 e82186d2e09caa6e9385c1b4874447b0acfa44bfe360852e8e1181c766393a19

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp39-cp39-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 37d7320186b67e7fa6f5478cd5757b2113f6b4158644a41ec64e281f3981d791
MD5 9c30ce1047e892d06a789453c9f3ee6b
BLAKE2b-256 9198c9c012f06a05fa1703e94ef8760a320328b7f06e4d6ae54d3914fbf2180d

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp38-cp38-win_amd64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp38-cp38-win_amd64.whl
Algorithm Hash digest
SHA256 f3bd404c5aadba7f5efc7dffe6cebb41c6620176324eb088a7771930093e3d86
MD5 e01ee065a75c409e438a27fc0fdc1c4d
BLAKE2b-256 59f18a7d469d056b6b29baf5fcccd67237b8e8b145ac421922cc886488cd5cbd

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_31_x86_64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_31_x86_64.whl
Algorithm Hash digest
SHA256 3af48aac233a940e44190d7a5f75380b23e25ae76cd3874f31cf20a3fd6d9d7a
MD5 453736fbf7e42fa28916669b5095d33e
BLAKE2b-256 0e634cfae58d532f059f240841b4ab5c3aa119f905e958227cef210a4f73e36c

See more details on using hashes here.

File details

Details for the file mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for mobilint_qb_runtime-1.3.2-cp38-cp38-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 1352f54ffc8815e79de791721838489616b908419b7a18c6cfce668c2628453c
MD5 1305dc7f1826eae2758752ad98210cfa
BLAKE2b-256 75ce02d48d02aae4e946d229ae7b208c807bd4cbe46d1f8b08243f87e77600d9

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

1.3.2 This release

21 files

1.3.1

21 files

1.2.0

15 files

1.1.0

15 files

1.0.0

10 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page