Skip to main content

A Python SDK for the Azure Databricks REST API 2.0.

Project description

Azure Databricks SDK Python

Workflow Status Coveralls github PyPI Downloads Docs GitHub

azure-databricks-sdk-python is a Python SDK for the Azure Databricks REST API 2.0.


Easily, perform all the operations as if on the Databricks UI:

from azure_databricks_sdk_python import Client
from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes

client = Client(databricks_instance="<instance>", personal_access_token="<token>")
spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
                            spark_version="7.2.x-scala2.12",
                            node_type_id="Standard_D3_v2",
                            spark_conf=spark_conf,
                            autoscale=autoscale)
created = client.clusters.create(attributes)
print(created.cluster_id)

Beloved Features

azure-databricks-sdk-python is ready for your use-case:

  • Clear standard to access to APIs.
  • Contains custom types for the API results and requests.
  • Support for Personal Access token authentification.
  • Support for Azure AD authentification.
  • Support for the use of Azure AD service principals.
  • Allows free-style API calls with a force mode -(bypass types validation).
  • Error handeling and proxy support.

Officially supports 3.6+, and runs great on PyPy.

Implementation Progress

Please refer to the progress below:

Feature Progress
Authentification 100% ✔
Custom types 25%
API Wrappers 25%
Error handling 80%
Proxy support 0%
Documentation 20%

As for specific API wrappers:

API Progress
Clusters API 100% ✔
Secrets API 100% ✔
Token API 100% ✔
Jobs API 0%
DBFS API 0%
Groups API 0%
Libraries API 0%
Workspace API 0%
Clusters Policies API 0%
Instance Pools API 0%
MLflow API 0%
Permissions API 0%
SCIM API 0%
Token Management API 0%

Documentation

Check the documentation on readthedocs.org.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for azure-databricks-sdk-python, version 0.0.2
Filename, size File type Python version Upload date Hashes
Filename, size azure_databricks_sdk_python-0.0.2-py3-none-any.whl (19.2 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size azure-databricks-sdk-python-0.0.2.tar.gz (31.2 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page