Skip to main content

A Python SDK for the Azure Databricks REST API 2.0.

Project description

Azure Databricks SDK Python

Workflow Status Coveralls github PyPI Downloads Docs GitHub

azure-databricks-sdk-python is a Python SDK for the Azure Databricks REST API 2.0.


Easily, perform all the operations as if on the Databricks UI:

from azure_databricks_sdk_python import Client
from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes

client = Client(databricks_instance="<instance>", personal_access_token="<token>")
spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
                            spark_version="7.2.x-scala2.12",
                            node_type_id="Standard_D3_v2",
                            spark_conf=spark_conf,
                            autoscale=autoscale)
created = client.clusters.create(attributes)
print(created.cluster_id)

Beloved Features

azure-databricks-sdk-python is ready for your use-case:

  • Clear standard to access to APIs.
  • Contains custom types for the API results and requests.
  • Support for Personal Access token authentification.
  • Support for Azure AD authentification.
  • Support for the use of Azure AD service principals.
  • Allows free-style API calls with a force mode -(bypass types validation).
  • Error handeling and proxy support.

Officially supports 3.6+, and runs great on PyPy.

Implementation Progress

Please refer to the progress below:

Feature Progress
Authentification 100% ✔
Custom types 25%
API Wrappers 25%
Error handling 80%
Proxy support 0%
Documentation 20%

As for specific API wrappers:

API Progress
Clusters API 100% ✔
Secrets API 100% ✔
Token API 100% ✔
Jobs API 0%
DBFS API 0%
Groups API 0%
Libraries API 0%
Workspace API 0%
Clusters Policies API 0%
Instance Pools API 0%
MLflow API 0%
Permissions API 0%
SCIM API 0%
Token Management API 0%

Documentation

Check the documentation on readthedocs.org.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

azure-databricks-sdk-python-0.0.2.tar.gz (31.2 kB view hashes)

Uploaded Source

Built Distribution

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page