Skip to main content

A Python SDK for the Azure Databricks REST API 2.0.

Project description

Azure Databricks SDK for Python

Workflow Status Coveralls github PyPI GitHub

A Python SDK for the Azure Databricks REST API 2.0

Install

You can install the package using pip:

pip install azure-databricks-sdk-python

Usage

from azure_databricks_sdk_python import Client

client = Client(databricks_instance="<instance>", personal_access_token="<token>")

Examples

How to create a cluster

You can use the defined types:

from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes

spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
                                spark_version="7.2.x-scala2.12",
                                node_type_id="Standard_D3_v2",
                                spark_conf=spark_conf,
                                autoscale=autoscale)
created_id = client.clusters.create(attributes)

or, you can force an API request with a dict:

attributes = {
    'cluster_name': 'my-cluster',
    'spark_version': '7.2.x-scala2.12',
    'node_type_id': 'Standard_D3_v2',
    'spark_conf': {
        'spark.speculation': True
    },
    'num_workers': 1
}
created_id = client.clusters.create(attributes, force=True)

Implementation Progress

Please refer to the progress below:

API Progress
Clusters API 80%
Clusters Policies API 0%
DBFS API 0%
Groups API 0%
Instance Pools API 0%
Jobs API 0%
Libraries API 0%
MLflow API 0%
Permissions API 0%
SCIM API 0%
Secrets API 0%
Token API 100% ✔
Token Management API 0%
Workspace API 0%

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for azure-databricks-sdk-python, version 0.0.1
Filename, size File type Python version Upload date Hashes
Filename, size azure_databricks_sdk_python-0.0.1-py3-none-any.whl (15.7 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size azure-databricks-sdk-python-0.0.1.tar.gz (20.1 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page