A Python SDK for the Azure Databricks REST API 2.0.
Project description
Azure Databricks SDK Python
Warning This project has been archived and is no longer actively maintained or supported. We highly recommend migrating to the official Databricks SDK for Python available at https://github.com/databricks/databricks-sdk-py.
azure-databricks-sdk-python is a Python SDK for the Azure Databricks REST API 2.0
.
Easily, perform all the operations as if on the Databricks UI:
from azure_databricks_sdk_python import Client
from azure_databricks_sdk_python.types.clusters import AutoScale, ClusterAttributes
client = Client(databricks_instance="<instance>", personal_access_token="<token>")
spark_conf = {'spark.speculation': True}
autoscale = AutoScale(min_workers=0, max_workers=1)
attributes = ClusterAttributes(cluster_name="my-cluster",
spark_version="7.2.x-scala2.12",
node_type_id="Standard_D3_v2",
spark_conf=spark_conf,
autoscale=autoscale)
created = client.clusters.create(attributes)
print(created.cluster_id)
Beloved Features
azure-databricks-sdk-python is ready for your use-case:
- Clear standard to access to APIs.
- Contains custom types for the API results and requests.
- Support for Personal Access token authentification.
- Support for Azure AD authentification.
- Support for the use of Azure AD service principals.
- Allows free-style API calls with a force mode -(bypass types validation).
- Error handeling and proxy support.
Officially supports 3.6+, and runs great on PyPy.
Implementation Progress
Please refer to the progress below:
Feature | Progress |
---|---|
Authentification | 100% ✔ |
Custom types | 25% |
API Wrappers | 25% |
Error handling | 80% |
Proxy support | 0% |
Documentation | 20% |
As for specific API wrappers:
API | Progress |
---|---|
Clusters API | 100% ✔ |
Secrets API | 100% ✔ |
Token API | 100% ✔ |
Jobs API | 0% |
DBFS API | 0% |
Groups API | 0% |
Libraries API | 0% |
Workspace API | 0% |
Clusters Policies API | 0% |
Instance Pools API | 0% |
MLflow API | 0% |
Permissions API | 0% |
SCIM API | 0% |
Token Management API | 0% |
Documentation
Check the documentation on readthedocs.org.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file azure-databricks-sdk-python-0.0.4.dev1.tar.gz
.
File metadata
- Download URL: azure-databricks-sdk-python-0.0.4.dev1.tar.gz
- Upload date:
- Size: 19.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9fe0dfcb216f2f0a64b617968a9470540e39973a3dce2fe83446a89eaf9e3319 |
|
MD5 | ce46a045675248856f4e5fb21db5b99e |
|
BLAKE2b-256 | 520532f9080b8ad2ea4c8cc9431f7cae6892df59c98a3cdb4b3dba3fbc259e93 |
File details
Details for the file azure_databricks_sdk_python-0.0.4.dev1-py3-none-any.whl
.
File metadata
- Download URL: azure_databricks_sdk_python-0.0.4.dev1-py3-none-any.whl
- Upload date:
- Size: 4.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.8
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f32bf2bcdaa28e696bc0166dde28a39a589ece6df0f55952a6d83a5bec5b92d4 |
|
MD5 | d345c36c75c4b05b5aa0514d79f3fa96 |
|
BLAKE2b-256 | 371d127c515ed458af5940077d29d77abfb66197687ecb3e14e19b3ec869a6a4 |