Skip to main content

AIVM: secure infrastructure for running MLaaS.

Project description

Nillion AIVM

AIVM is a framework designed for private inference using cryptographic protocols. This project allows you to run a development network (devnet) and perform private inference tasks using examples provided in the repository.

Table of Contents

Installing AIVM

Recommended Instalation

  1. Install on your existing OS python installation. Requires Python >=3.12:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  2. Install dependencies:

    pip install .
    

If you are going to run the examples, do:

pip install ".[examples]"

Using Poetry

  1. Install Poetry (if not already installed):

    pip install poetry
    
  2. Clone the repository:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  3. Install dependencies:

    poetry install
    
  4. Activate the virtual environment:

    poetry shell
    
  5. Install AIVM:

    poetry install
    

Using venv

  1. Clone the repository:

    git clone https://github.com/NillionNetwork/aivm.git
    cd aivm
    
  2. Create a virtual environment:

    python3 -m venv .venv
    
  3. Activate the virtual environment:

    On Linux/macOS:

    source .venv/bin/activate
    

    On Windows:

    .\venv\Scripts\activate
    
  4. Install the package:

    pip install .
    

Running AIVM

  1. Start the AIVM devnet:

    aivm-devnet
    
  2. Open the provided Jupyter notebook examples/getting-started.ipynb to run private inference examples on AIVM.

  3. After completing your tasks, terminate the devnet process by pressing CTRL+C.

Usage

For additional usage, refer to the examples provided in the examples folder, which demonstrates how to set up private inference workflows using AIVM.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nillion_aivm-0.1.1.tar.gz (18.2 MB view details)

Uploaded Source

Built Distribution

nillion_aivm-0.1.1-py3-none-any.whl (18.4 MB view details)

Uploaded Python 3

File details

Details for the file nillion_aivm-0.1.1.tar.gz.

File metadata

  • Download URL: nillion_aivm-0.1.1.tar.gz
  • Upload date:
  • Size: 18.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for nillion_aivm-0.1.1.tar.gz
Algorithm Hash digest
SHA256 310c86149f05c72f8d23a2419b380e0cbd2e65846d4eecce22bf632d7bf9ae6c
MD5 f9a8bb9f0c8b1320555762ddc6af9d7e
BLAKE2b-256 7200fcdcea91db997c485edeb205bb64dac627a515b44747aa7e7323545905e8

See more details on using hashes here.

File details

Details for the file nillion_aivm-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: nillion_aivm-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 18.4 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for nillion_aivm-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c32d7dab8acae4093ad8e5f64d9107b33b84589e810301ffa4b8a3c1629f9b13
MD5 d074e084592f8001b420eb283c9d8bd5
BLAKE2b-256 7e8d0ce71411f846fe82ab6806bed51079c0bfd400b55ddb6e7c820c0169f07d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page