ml-infer 0.0.3

Inference toolkit for machine learning models

Infer

infer is a toolchain for doing optimized neural network inference with a number of different backends.

Installation

Install from pip:

pip install ml-infer
# With development dependencies
pip install 'ml-infer[dev]'
# With TensorRT support
pip install 'ml-infer[tensorrt]'
# With CoreML support
pip install 'ml-infer[coreml]'
# With developer dependencies and TensorRT support
pip install 'ml-infer[dev,tensorrt]'
# With developer dependencies and CoreML support
pip install 'ml-infer[dev,coreml]'

Supported Backend

• TensorRT
• CoreML

References

• Official TensorRT Export Pipeline
• Official CoreML Repository