Skip to main content

The Databricks plugin for dbt (data build tool)

Project description

databricks logo dbt logo

Unit Tests Badge Integration Tests Badge

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

The Databricks Lakehouse provides one simple platform to unify all your data, analytics and AI workloads.

dbt-databricks

The dbt-databricks adapter contains all of the code enabling dbt to work with Databricks.

This adapter is based off the amazing work done in dbt-spark

Getting started

Installation

Install using pip:

pip install dbt-databricks

Upgrade to the latest version

pip install --upgrade dbt-databricks

Profile Setup

your_profile_name:
  target: dev
  outputs:
    dev:
      type: databricks
      schema: [database/schema name]
      host: [your.databrickshost.com]
      http_path: [/sql/your/http/path]
      token: [dapiXXXXXXXXXXXXXXXXXXXXXXX]

Compatibility

The dbt-databricks adapter has been tested against Databricks SQL and Databricks runtime releases 7.3 LTS and later.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbt-databricks-0.21.1.tar.gz (17.5 kB view details)

Uploaded Source

Built Distribution

dbt_databricks-0.21.1-py3-none-any.whl (21.6 kB view details)

Uploaded Python 3

File details

Details for the file dbt-databricks-0.21.1.tar.gz.

File metadata

  • Download URL: dbt-databricks-0.21.1.tar.gz
  • Upload date:
  • Size: 17.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/0.0.0 importlib_metadata/4.8.1 pkginfo/1.8.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for dbt-databricks-0.21.1.tar.gz
Algorithm Hash digest
SHA256 3cbec944a08a13341278d88de3c554b9bf8215c30276e39a445c98da034a6bda
MD5 b853fb0362dba3f2d906b622243fda89
BLAKE2b-256 d862ced4ebc6a307af0c73f1e8cc672dbee561414b1a14f512c5245359766091

See more details on using hashes here.

File details

Details for the file dbt_databricks-0.21.1-py3-none-any.whl.

File metadata

  • Download URL: dbt_databricks-0.21.1-py3-none-any.whl
  • Upload date:
  • Size: 21.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/0.0.0 importlib_metadata/4.8.1 pkginfo/1.8.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.7

File hashes

Hashes for dbt_databricks-0.21.1-py3-none-any.whl
Algorithm Hash digest
SHA256 710461fa4d5069538e772fa3f021280f62b4912757337d1d7640e59eab1e3180
MD5 d5dc722af66cf8ce53d58b9e79a0ee2a
BLAKE2b-256 d0e005eabf971578b8c3ba077f1b975fa641474b6f2c84c23f4bd078491ca9c3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page