Skip to main content

A Python SDK for the Azure Databricks REST API 2.0.

Project description

Azure Databricks SDK Python

Warning This project has been archived and is no longer actively maintained or supported. We highly recommend migrating to the official Databricks SDK for Python available at https://github.com/databricks/databricks-sdk-py.

Workflow Status Coveralls github PyPI Downloads Docs GitHub

azure-databricks-sdk-python is a Python SDK for the Azure Databricks REST API 2.0.


Easily, perform all the operations as if on the Databricks UI:

from azure_databricks_sdk_python import Client
from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes

client = Client(databricks_instance="<instance>", personal_access_token="<token>")
spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
                            spark_version="7.2.x-scala2.12",
                            node_type_id="Standard_D3_v2",
                            spark_conf=spark_conf,
                            autoscale=autoscale)
created = client.clusters.create(attributes)
print(created.cluster_id)

Beloved Features

azure-databricks-sdk-python is ready for your use-case:

  • Clear standard to access to APIs.
  • Contains custom types for the API results and requests.
  • Support for Personal Access token authentification.
  • Support for Azure AD authentification.
  • Support for the use of Azure AD service principals.
  • Allows free-style API calls with a force mode -(bypass types validation).
  • Error handeling and proxy support.

Officially supports 3.6+, and runs great on PyPy.

Implementation Progress

Please refer to the progress below:

Feature Progress
Authentification 100% ✔
Custom types 25%
API Wrappers 25%
Error handling 80%
Proxy support 0%
Documentation 20%

As for specific API wrappers:

API Progress
Clusters API 100% ✔
Secrets API 100% ✔
Token API 100% ✔
Jobs API 0%
DBFS API 0%
Groups API 0%
Libraries API 0%
Workspace API 0%
Clusters Policies API 0%
Instance Pools API 0%
MLflow API 0%
Permissions API 0%
SCIM API 0%
Token Management API 0%

Documentation

Check the documentation on readthedocs.org.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file azure-databricks-sdk-python-0.0.4.dev1.tar.gz.

File metadata

File hashes

Hashes for azure-databricks-sdk-python-0.0.4.dev1.tar.gz
Algorithm Hash digest
SHA256 9fe0dfcb216f2f0a64b617968a9470540e39973a3dce2fe83446a89eaf9e3319
MD5 ce46a045675248856f4e5fb21db5b99e
BLAKE2b-256 520532f9080b8ad2ea4c8cc9431f7cae6892df59c98a3cdb4b3dba3fbc259e93

See more details on using hashes here.

File details

Details for the file azure_databricks_sdk_python-0.0.4.dev1-py3-none-any.whl.

File metadata

File hashes

Hashes for azure_databricks_sdk_python-0.0.4.dev1-py3-none-any.whl
Algorithm Hash digest
SHA256 f32bf2bcdaa28e696bc0166dde28a39a589ece6df0f55952a6d83a5bec5b92d4
MD5 d345c36c75c4b05b5aa0514d79f3fa96
BLAKE2b-256 371d127c515ed458af5940077d29d77abfb66197687ecb3e14e19b3ec869a6a4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page