iomete-sdk 2.0.0

IOMETE SDK for Python.

IOMETE SDK

This is the IOMETE SDK for Python. It provides convenient access to the IOMETE API from applications written in the Python language.

Installation

Install the package with:

pip install iomete-sdk

Usage

Spark Job API

Import and initialize the client:

from iomete_sdk.spark import SparkJobApiClient
from iomete_sdk.api_utils import ClientError

HOST = "<YOUR_DATAPLANE_HOST>" # https://dataplane-endpoint.example.com
API_KEY = "<YOU_IOMETE_API_KEY>"

job_client = SparkJobApiClient(
    host=HOST,
    api_key=API_KEY,
)

Create a new job:

response = job_client.create_job(payload={
        "name": "job-name",
        "template": {
            "main_application_file": "local:///opt/spark/examples/jars/spark-examples_2.12-3.2.1-iomete.jar",
            "main_class": "org.apache.spark.examples.SparkPi",
            "arguments": ["10"]
        }
    })

job_id = response["id"]

Get jobs:

response = job_client.get_jobs()

Get job:

response = job_client.get_job(job_id=job_id)

Update job:

response = job_client.update_job(job_id=job_id, payload={
        "template": {
            "main_application_file": "local:///opt/spark/examples/jars/spark-examples_2.12-3.2.1-iomete.jar",
            "main_class": "org.apache.spark.examples.SparkPi",
            "arguments": ["10"]
        }
    })

Delete job:

response = job_client.delete_job(job_id=job_id)

Submit job run:

response = job_client.submit_job_run(job_id=job_id, payload={})

Cancel job run:

response = job_client.cancel_job_run(job_id=job_id, run_id=run_id)

Get Job Runs:

response = job_client.get_job_runs(job_id=job_id)

Get Job Run:

response = job_client.get_job_run(job_id=job_id, run_id=run_id)

Get Job Run Logs:

response = job_client.get_job_run_logs(job_id=job_id, run_id=run_id)

Get Job Run Metrics:

response = job_client.get_job_run_metrics(job_id=job_id, run_id=run_id)