qai-hub 0.16.0

Python API for Qualcomm® AI Hub.

Qualcomm® AI Hub simplifies deploying AI models for vision, audio, and speech applications to edge devices.

helps to optimize, validate, and deploy machine learning models on-device for vision, audio, and speech use cases.

With Qualcomm® AI Model Hub, you can:

• Convert trained models from frameworks like PyTorch for optimized on-device performance on Qualcomm® devices.

• Profile models on-device to obtain detailed metrics including runtime, load time, and compute unit utilization.

• Verify numerical correctness by performing on-device inference.

• Easily deploy models using Qualcomm® AI Engine Direct or TensorFlow Lite.

qai_hub is a python package that provides an API for users to upload a model, submit the profile jobs for hardware and get key metrics to optimize the machine learning model further.

Installation with PyPI

The easiest way to install qai_hub is by using pip, running

pip install qai-hub

For more information, check out the documentation.

License

Copyright (c) 2023, Qualcomm Technologies Inc. All rights reserved.