Databricks SQL Connector for Python
The Databricks SQL Connector for Python allows you to develop Python applications that connect to Databricks clusters and SQL warehouses. It is a Thrift-based client with no dependencies on ODBC or JDBC. It conforms to the Python DB API 2.0 specification.
This connector uses Arrow as the data-exchange format, and supports APIs (e.g. fetchmany_arrow) to directly fetch Arrow tables. Arrow tables are wrapped in the ArrowQueue class to provide a natural API to get several rows at a time. PyArrow is required to enable this and use these APIs, you can install it via pip install pyarrow or pip install databricks-sql-connector[pyarrow].
You are welcome to file an issue here for general use cases. You can also contact Databricks Support here.
Requirements
Python 3.8 or above is required.
Documentation
For the latest documentation, see
Quickstart
Installing the core library
Install using pip install databricks-sql-connector
Installing the core library with PyArrow
Install using pip install databricks-sql-connector[pyarrow]
export DATABRICKS_HOST=********.databricks.com
export DATABRICKS_HTTP_PATH=/sql/1.0/endpoints/****************
Example usage:
import os
from databricks import sql
host = os.getenv("DATABRICKS_HOST")
http_path = os.getenv("DATABRICKS_HTTP_PATH")
connection = sql.connect(
server_hostname=host,
http_path=http_path)
cursor = connection.cursor()
cursor.execute('SELECT :param `p`, * FROM RANGE(10)', {"param": "foo"})
result = cursor.fetchall()
for row in result:
print(row)
cursor.close()
connection.close()
In the above example:
server-hostnameis the Databricks instance host name.http-pathis the HTTP Path either to a Databricks SQL endpoint (e.g. /sql/1.0/endpoints/1234567890abcdef), or to a Databricks Runtime interactive cluster (e.g. /sql/protocolv1/o/1234567890123456/1234-123456-slid123)
Note: This example uses Databricks OAuth U2M to authenticate the target Databricks user account and needs to open the browser for authentication. So it can only run on the user's machine.
SQLAlchemy
Starting from databricks-sql-connector version 4.0.0 SQLAlchemy support has been extracted to a new library databricks-sqlalchemy.
- Github repository databricks-sqlalchemy github
- PyPI databricks-sqlalchemy pypi
Quick SQLAlchemy guide
Users can now choose between using the SQLAlchemy v1 or SQLAlchemy v2 dialects with the connector core
- Install the latest SQLAlchemy v1 using
pip install databricks-sqlalchemy~=1.0 - Install SQLAlchemy v2 using
pip install databricks-sqlalchemy
Contributing
See CONTRIBUTING.md
License
Metadata
Release files for databricks-sql-connector 4.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| databricks_sql_connector-4.0.0.tar.gz | 316.0 kB | Without provenance | Details for databricks_sql_connector-4.0.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| databricks_sql_connector-4.0.0-py3-none-any.whl | Python 3 | none | any | Details for databricks_sql_connector-4.0.0-py3-none-any.whl |
Total release size: 640.6 kB
Release files / databricks_sql_connector-4.0.0.tar.gz
| Download URL | databricks_sql_connector-4.0.0.tar.gz |
|---|---|
| Size | 316.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3634fe3d19ee4641cdf76a77854573d9fe234ccdebd20230aaf94053397bc693
|
|
BLAKE2b-256 checksum How to use checksums |
1d9d1ae930a513debad79a5fecf9542d1aaf1e37090025a0a29e1eb2a90dd550
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.9.6
|
Release files / databricks_sql_connector-4.0.0-py3-none-any.whl
| Download URL | databricks_sql_connector-4.0.0-py3-none-any.whl |
|---|---|
| Size | 324.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
798ebc740e992eaf435754510d1035872d3ebbc8c5cb597aa939217220463236
|
|
BLAKE2b-256 checksum How to use checksums |
405f9682d4ba3e46964c8934a2481fcd8a0740c276af0c765d027a9c1cf7af9c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.9.6
|
Security for databricks-sql-connector 4.0.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.