iomete-sdk 1.0.1

IOMETE SDK for Python.

IOMETE SDK

This is the IOMETE SDK for Python. It provides convenient access to the IOMETE API from applications written in the Python language.

Installation

Install the package with:

pip install iomete-sdk

Usage

Spark Job API

Import and initialize the client:

from iomete_sdk import SparkJobApiClient, ClientError

WORKSPACE_ID = "<YOUR_WORKSPACE_ID>"
API_KEY = "<YOU_IOMETE_API_KEY>"

job_client = SparkJobApiClient(
        workspace_id=WORKSPACE_ID,
        api_key=API_KEY,
    )

Create a new job:

response = job_client.create_job(payload={
        "name": "job-name",
        "template": {
            "main_application_file": "local:///opt/spark/examples/jars/spark-examples_2.12-3.2.1-iomete.jar",
            "main_class": "org.apache.spark.examples.SparkPi",
            "arguments": ["10"]
        }
    })

job_id = response["id"]

Get jobs:

response = job_client.get_jobs()

Get job:

response = job_client.get_job(job_id=job_id)

Update job:

response = job_client.update_job(job_id=job_id, payload={
        "template": {
            "main_application_file": "local:///opt/spark/examples/jars/spark-examples_2.12-3.2.1-iomete.jar",
            "main_class": "org.apache.spark.examples.SparkPi",
            "arguments": ["10"]
        }
    })

Delete job:

response = job_client.delete_job(job_id=job_id)

Submit job run:

response = job_client.submit_job_run(job_id=job_id, payload={})

Cancel job run:

response = job_client.cancel_job_run(job_id=job_id, run_id=run_id)

Get Job Runs:

response = job_client.get_job_runs(job_id=job_id)

Get Job Run:

response = job_client.get_job_run(job_id=job_id, run_id=run_id)

Get Job Run Logs:

response = job_client.get_job_run_logs(job_id=job_id, run_id=run_id)

Get Job Run Metrics:

response = job_client.get_job_run_metrics(job_id=job_id, run_id=run_id)