Skip to main content

Databricks bundle for the Bricksflow framework

Project description

Databricks bundle

This bundle allows you to write beautiful function-based notebooks.

alt text

Compared to bare notebooks, the function-based approach brings the following advantages:

  1. create and publish auto-generated documentation and lineage of notebooks and pipelines (Bricksflow PRO)
  2. write much cleaner notebooks with properly named code blocks
  3. (unit)test specific notebook functions with ease
  4. use YAML to configure your notebooks for given environment (dev/test/prod/...)
  5. utilize pre-configured objects to automate repetitive tasks

Function-based notebooks have been designed to provide the same user-experience as bare notebooks. Just write the function, annotate it with the @notebookFunction decorator and run the cell.

This bundle is the main part of the Bricksflow framework.

Installation

Install the bundle via Poetry:

$ poetry add databricks-bundle && poetry add databricks-connect --dev

Usage

  1. Writing function-based notebooks
  2. Using pre-configured objects
  3. Configuring notebook functions
  4. Databricks Connect setup

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for databricks-bundle, version 0.7.2
Filename, size File type Python version Upload date Hashes
Filename, size databricks_bundle-0.7.2-py3-none-any.whl (28.6 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page