runpod 0.6.5

Official Python library for RunPod API & SDK.

RunPod | Python Library

 

Official Python library for RunPod API & SDK.

Table of Contents

• Table of Contents
• Installation
• API Language Library
• SDK - Serverless Worker
  • Quick Start

Installation

pip install runpod

API Language Library

When interacting with the RunPod API you can use this library to make requests to the API.

import runpod

runpod.api_key = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

SDK - Serverless Worker

This python package can also be used to create a serverless worker that can be deployed to RunPod.

Quick Start

Create an python script in your project that contains your model definition and the RunPod worker start code. Run this python code as your default container start command:

import runpod

MODEL = 'YOUR_MODEL'

def run(job):
    # Your inference code here
    return MODEL.predict(job.input)

runpod.serverless.start({"handler": run})

Add the env variables found in serverless-worker to your project.