opengradient 0.3.8

Python SDK for OpenGradient decentralized model management & inference services

OpenGradient Python SDK

Python SDK for the OpenGradient platform provides decentralized model management & inference services. Python SDK allows programmatic access to our model repository and decentralized AI infrastructure.

Installation

To install Python SDK and CLI, run the following command:

pip install opengradient

Quick Start

To get started, run:

import opengradient as og
og.init(private_key="<private_key>", email="<email>", password="<password>")

The following commands show how to use Python SDK.

Create a Model

og.create_model(model_name="<model_name>", model_desc="<model_description>")

Create a Model (with file upload)

og.create_model(model_name="<model_name>", model_desc="<model_description>", model_path="<model_path>")

Create a Version of a Model

og.create_version(model_name="<model_name>", notes="<model_notes>")

Upload Files to a Model

og.upload(model_path="<model_path>", model_name="<model_name>", version="<version>")

List Files of a Model Version

og.list_files(model_name="<model_name>", version="<version>")

Run Inference

inference_mode = og.InferenceMode.VANILLA
og.infer(model_cid, model_inputs, inference_mode)

• inference mode can be VANILLA, ZKML, or TEE

Using the CLI

export OPENGRADIENT_EMAIL="<email>"
export OPENGRADIENT_PASSWORD="<password>"

Creating a Model Repo

opengradient create_model_repo "<model_name>" "<description>" 

• creating a model automatically initializes version v0.01

Creating a Version

opengradient create_model_repo "<model_name>" "<description>" 

Upload a File

opengradient upload "<model_path>" "<model_name>" "<version>" 

List Files of a Model Version

opengradient list_files "<model_name>" "<version>"

CLI infer using string

opengradient infer QmbUqS93oc4JTLMHwpVxsE39mhNxy6hpf6Py3r9oANr8aZ VANILLA '{"num_input1":[1.0, 2.0, 3.0], "num_input2":10, "str_input1":["hello", "ONNX"], "str_input2":" world"}'

CLI infer using file path input

opengradient infer QmbUqS93oc4JTLMHwpVxsE39mhNxy6hpf6Py3r9oANr8aZ VANILLA --input_file input.json

Run LLM Inference

opengradient llm --model "meta-llama/Meta-Llama-3-8B-Instruct" --prompt "Translate to French: Hello, how are you?" --max-tokens 50 --temperature 0.7

For more information read the OpenGradient documentation.