pruna-engine 0.5.2

Run AI models smashed by Pruna AI

Pruna Engine

Pruna Engine is a Python package providing the capability of running deep learning models optimized through Pruna AI.

Installation

You can install Pruna Engine via pip from PyPI:

CPU

pip install pruna-engine

GPU

pip install pruna-engine[gpu] --extra-index-url https://pypi.nvidia.com --extra-index-url https://pypi.ngc.nvidia.com

Requirements

• You need CUDA 12 to be installed on your machine for the GPU version
• You need to have CUDA toolkit installed on your machine. If you are using a conda environment you can do this by running:

conda install nvidia/label/cuda-12.1.0::cuda

• We support python 3.8, 3.9, or 3.10

Usage

Here is a simple example of how to use Pruna Engine with a ResNet50 optimized model:

from pruna_engine.PrunaModel import PrunaModel

# And 'your_api_key' is your actual API key
your_api_key = 'test'
smashed_model = PrunaModel.load_model('resnet50_model', your_api_key)
# Run prediction
y = smashed_model(x)

License

All Rights Reserved

Copyright 2023 Pruna AI