azure-databricks-sdk-python 0.0.1

A Python SDK for the Azure Databricks REST API 2.0.

Azure Databricks SDK for Python

A Python SDK for the Azure Databricks REST API 2.0

Install

You can install the package using pip:

pip install azure-databricks-sdk-python

Usage

from azure_databricks_sdk_python import Client

client = Client(databricks_instance="<instance>", personal_access_token="<token>")

Examples

How to create a cluster

You can use the defined types:

from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes

spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
                                spark_version="7.2.x-scala2.12",
                                node_type_id="Standard_D3_v2",
                                spark_conf=spark_conf,
                                autoscale=autoscale)
created_id = client.clusters.create(attributes)

or, you can force an API request with a dict:

attributes = {
    'cluster_name': 'my-cluster',
    'spark_version': '7.2.x-scala2.12',
    'node_type_id': 'Standard_D3_v2',
    'spark_conf': {
        'spark.speculation': True
    },
    'num_workers': 1
}
created_id = client.clusters.create(attributes, force=True)

Implementation Progress

Please refer to the progress below:

API	Progress
Clusters API	80%
Clusters Policies API	0%
DBFS API	0%
Groups API	0%
Instance Pools API	0%
Jobs API	0%
Libraries API	0%
MLflow API	0%
Permissions API	0%
SCIM API	0%
Secrets API	0%
Token API	100% ✔
Token Management API	0%
Workspace API	0%