AIVM: secure infrastructure for running MLaaS.
Project description
Nillion AIVM
AIVM is a framework designed for private inference using cryptographic protocols. This project allows you to run a development network (devnet) and perform private inference tasks using examples provided in the repository.
Table of Contents
Installing AIVM
Recommended Instalation
-
Install on your existing OS python installation. Requires Python >=3.12:
git clone https://github.com/NillionNetwork/aivm.git cd aivm
-
Install dependencies:
pip install .
If you are going to run the examples, do:
pip install ".[examples]"
Using Poetry
-
Install Poetry (if not already installed):
pip install poetry
-
Clone the repository:
git clone https://github.com/NillionNetwork/aivm.git cd aivm
-
Install dependencies:
poetry install
-
Activate the virtual environment:
poetry shell
-
Install AIVM:
poetry install
Using venv
-
Clone the repository:
git clone https://github.com/NillionNetwork/aivm.git cd aivm
-
Create a virtual environment:
python3 -m venv .venv
-
Activate the virtual environment:
On Linux/macOS:
source .venv/bin/activate
On Windows:
.\venv\Scripts\activate
-
Install the package:
pip install .
Running AIVM
-
Start the AIVM devnet:
aivm-devnet
-
Open the provided Jupyter notebook
examples/getting-started.ipynb
to run private inference examples on AIVM. -
After completing your tasks, terminate the devnet process by pressing
CTRL+C
.
Usage
For additional usage, refer to the examples provided in the examples
folder, which demonstrates how to set up private inference workflows using AIVM.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file nillion_aivm-0.1.2.tar.gz
.
File metadata
- Download URL: nillion_aivm-0.1.2.tar.gz
- Upload date:
- Size: 18.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c538439e19594af78d838b5ba134526b907d1a0bb2ed49b4c049f83ac6f2c469 |
|
MD5 | 99430c9a89fb1292e713030a96919cd3 |
|
BLAKE2b-256 | c1ef30ae0ddc12805088f50ec42da4bed57f0b55eb909f22792efdbae0a3e026 |
File details
Details for the file nillion_aivm-0.1.2-py3-none-any.whl
.
File metadata
- Download URL: nillion_aivm-0.1.2-py3-none-any.whl
- Upload date:
- Size: 18.4 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0cd4c22db9ff9f1980f9c1bbd41a037c9f537610b45140c76ed6d6db59155966 |
|
MD5 | e98dea8faa5ec225491c5da24e49b727 |
|
BLAKE2b-256 | f74956489aa59df1cf4fbedaf6e24b1dd0b2be34e1c1ce634a4eb68cd29ef0ed |