runapy 0.8.0

Python client for Run:ai REST API

runapy

Run:ai platform streamlines AI workload orchestration.
Enabling organizations to efficiently manage and scale their machine learning tasks while optimizing resource utilization.

runapy is a Python client SDK that empowers researchers and admins to interact programmatically with Run:ai thourgh the Run:ai REST API.

Core Capabilities:

• A single class interface to perform all API actions
• Automatic API token refresh
• Built-in retry mechanism for handling transient network errors
• Body schema validation on compilation (with Pydantic)
• Static type checks
• Debug messages flag

Table of Contents

1. Requirements
2. Installation
3. Client
4. Controllers
5. Examples
6. Using CLIv2 Token
7. Warranty
8. License

Requirements

• Run:ai control-plane version >= 2.18: The SDK requires Run:ai control-plane version 2.18 or higher for compatibility with its API features
• Python version >= 3.11: Compatibility with libraries and language features
• Run:ai Client Application: A client application is needed to generate the client_id and client_secret credentials required for API access. How to create a client application

[!NOTE] Ensure the created application has the required role and scope permissions for the necessary API actions.
Some API calls may fail with a 403 error if the token lacks sufficient permissions.
Refer to the Run:ai roles for more details on roles and permitted actions.

Installation

runapy is available in PyPi and can be downloaded directly as a python package

pip3 install runapy

We recommend using a Python virtual environment to avoid package conflicts.

python3 -m venv myenv
source myenv/bin/activate
pip3 install runapy

Client

RunaiClient is the only class required to interact with the Run:ai REST API

from runai.client import RunaiClient

client = RunaiClient(
            client_id="API",
            client_secret="clientsecret",
            runai_base_url="https://myorg.run.ai",
            cluster_id="513423qx-127t-4yk6-979g-5po843g37e2b",
            retries=3,
    )

Parameter	Type	Description
client_id	string	Required: The Run:ai application client ID, usually representing the application name
client_secret	string	Required: The client secret associated with the Run:ai application, acting as a password
runai_base_url	string	Required: The base URL for the Run:ai instance your organization uses. Example: https://myorg.run.ai
bearer_token	string	Optional: The API bearer token. Used for CLIv2 compatibility
retries	int	Optional: Number of retries to attempt on each failed API call for 5xx errors. Default is 1
cluster_id	string	Optional: The ID of the cluster. Default is None
debug	bool	Optional: Debug mode output. Default is False

[!NOTE] The cluster_id must be present to use endpoints that have cluster_id required in payload according to Run:ai REST API.
Therefore, it is recommended to always set a cluster_id, either in the RunaiClient init or with client.config_cluster_id

If you don't have the cluster_id, it can be obtained with:

# multi-cluster tenants
clusters = client.clusters.all() <- Returns a list
clusters_list = {}
for cluster in clusters:
    clusters_list[cluster["name"]] = cluster["uuid"]

# clusters_list -> {'prod-cluster': '028642ff-fb2f-46e8-95fe-a60401e6b2da', 'test-cluster': '461619fd-127a-4cc6-979c-5cd843a37a2d'}

cluster_id = clusters_list["prod-cluster"]

# Single cluster tenants
cluster_id = client.clusters.all()[0]["uuid"]

Then, configure the client with the cluster id:

client.config_cluster_id(cluster_id)

Note on Controllers

The RunaiClient exposes object controllers, which provide a convenient way to interact with specific resources on the Run:ai platform. For example, to access projects:

from runai.client import RunaiClient

client = RunaiClient(
            client_id="API",
            client_secret="clientsecret",
            runai_base_url="https://myorg.run.ai",
            cluster_id="513423qx-127t-4yk6-979g-5po843g37e2b",
            retries=3,
    )

client.projects.all()

client.projects.all() returns a list of all projects in a given cluster according to the client's cluster id.

Currently supported controllers:

client.projects
client.node_pools
client.departments
client.access_rules
client.roles
client.users

client.workloads
client.workspace
client.training
client.inference
client.distributed

client.assets.pvc
client.assets.s3
client.assets.git
client.assets.nfs
client.assets.credentials.access_key
client.assets.credentials.password
client.assets.credentials.docker_registry_secret

Each controller exposes the function options() so you can see which methods are currently available for a given controller.
For example:

client.roles.options()
-> 
['all', 'get', 'get_roles_name_to_id_map']

Controller methods are documented.
Hover on the method parentheses to see the required and optional fields to pass to the function.

Examples

Check the examples section here for common API interactions, such as:

• Create, list, and patch projects/department resources in a cluster
• Create Nvidia nim llama inference workload
• Create, Delete, Stop, and Resume training and interactive workloads
• Creating and modifying access rules and user roles
• Managing PVC, S3, NFS, Git Run:ai assets
• And more

Feel free to copy and run them as is, modify them as needed, or use them as a reference.

CLIv2 token

The package supports making API calls with the same user entity defined in the authentication.json file, generated by CLIv2 runai login.
Before executing the code below, ensure CLIv2 is installed, runai login has been executed, and a successful login has been completed.

[!NOTE] The CLI token has an expiration time of 24 hours
Make sure to generate a new token by re-login with runai login if 24 have passed since the last login

To authenticate with the CLIv2 user configuration:

from runai.client import RunaiClient
from runai.cliv2_config_loader import CLIv2Config

config = CLIv2Config(cliv2_config_path="/path/to/.runai")

config.load()

token = config.token
runai_base_url = config.control_plane_url
cluster_id = config.cluster_uuid

client = RunaiClient(
    cluster_id=cluster_id,
    bearer_token=token,
    runai_base_url=runai_base_url
)

The example is also documented here with added instructions.

Warranty

This package is an open-source project maintained by the Run:ai Professional Services team.
While the package is not an official product of Run:ai, it is actively maintained with a commitment to continued development.

In the future, the project is planned to become community-driven, inviting contributions and collaboration from users and the broader open-source community.

If you experience any issues or have feature requests, please submit them via the repository’s issue tracker.
Your feedback is highly appreciated and will help guide the project's future direction.

License

This project is licensed under the MIT License. See the LICENSE file for details.