Skip to main content

AIVM: secure infrastructure for running MLaaS.

Project description

Nillion AIVM

AIVM is a framework designed for private inference using cryptographic protocols. This project allows you to run a development network (devnet) and perform private inference tasks using examples provided in the repository.

Table of Contents

Installing AIVM

Recommended Instalation

  1. Install on your existing OS python installation. Requires Python >=3.12:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  2. Install dependencies:

    pip install .
    

If you are going to run the examples, do:

pip install ".[examples]"

Using Poetry

  1. Install Poetry (if not already installed):

    pip install poetry
    
  2. Clone the repository:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  3. Install dependencies:

    poetry install
    
  4. Activate the virtual environment:

    poetry shell
    
  5. Install AIVM:

    poetry install
    

Using venv

  1. Clone the repository:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  2. Create a virtual environment:

    python3 -m venv .venv
    
  3. Activate the virtual environment:

    On Linux/macOS:

    source .venv/bin/activate
    

    On Windows:

    .\venv\Scripts\activate
    
  4. Install the package:

    pip install .
    

Running AIVM

  1. Start the AIVM devnet:

    aivm-devnet
    
  2. Open the provided Jupyter notebook examples/getting-started.ipynb to run private inference examples on AIVM.

  3. After completing your tasks, terminate the devnet process by pressing CTRL+C.

Usage

For additional usage, refer to the examples provided in the examples folder, which demonstrates how to set up private inference workflows using AIVM.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nillion_aivm-0.1.2.tar.gz (18.2 MB view details)

Uploaded Source

Built Distribution

nillion_aivm-0.1.2-py3-none-any.whl (18.4 MB view details)

Uploaded Python 3

File details

Details for the file nillion_aivm-0.1.2.tar.gz.

File metadata

  • Download URL: nillion_aivm-0.1.2.tar.gz
  • Upload date:
  • Size: 18.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for nillion_aivm-0.1.2.tar.gz
Algorithm Hash digest
SHA256 c538439e19594af78d838b5ba134526b907d1a0bb2ed49b4c049f83ac6f2c469
MD5 99430c9a89fb1292e713030a96919cd3
BLAKE2b-256 c1ef30ae0ddc12805088f50ec42da4bed57f0b55eb909f22792efdbae0a3e026

See more details on using hashes here.

File details

Details for the file nillion_aivm-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: nillion_aivm-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 18.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for nillion_aivm-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0cd4c22db9ff9f1980f9c1bbd41a037c9f537610b45140c76ed6d6db59155966
MD5 e98dea8faa5ec225491c5da24e49b727
BLAKE2b-256 f74956489aa59df1cf4fbedaf6e24b1dd0b2be34e1c1ce634a4eb68cd29ef0ed

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page