femtocrux 0.2.9

Femtosense Compiler

femtocrux

Compiler API for the Femotsense Sparse Processing Unit (SPU).

This package drives compilation of machine learning models to SPU binaries, as well as simulation of those binaries on SPU hardware.

The package itself is a thin Python wrapper communicating to the actual compiler / simulator via gRPC.

Supported ML model representations:

• Femtosense Quantized IR (FQIR)
• Tensorflow Lite (TFLite)

Installation

You will need to have python 3.10 and Docker installed. Install Docker by following these instructions.

femtocrux is available on PyPI via

pip install femtocrux

Basic Usage

# fqir_model = ... # Assuming we have an FQIRModel
# inputs = ... # Assuming we have inputs for the model

from femtocrux import CompilerClient
client = CompilerClient()
simulator = client.simulate(fqir_model)
outputs = simulator.simulate(inputs)

APIs

Coming soon...