databricks-bundle 0.6.0a5

Databricks bundle for the Pyfony framework

Databricks bundle

This bundle helps you to create simple function-based Databricks notebooks, which can be easily auto-documented and unit-tested. It is part of the Bricksflow framework.

Installation

Install the bundle via Poetry:

$ poetry add databricks-bundle && poetry add databricks-connect --dev

Add the DatabricksBundle.autodetect() to your application's Kernel.py to activate it:

from pyfony.kernel.BaseKernel import BaseKernel
from databricksbundle.DatabricksBundle import DatabricksBundle

class Kernel(BaseKernel):
    
    def _registerBundles(self):
        return [
            # ...
            DatabricksBundle.autodetect(),
            # ...
        ]

Usage

1. Writing function-based notebooks
2. Recommended notebooks structure
3. Configuring notebook functions
4. Using dependencies
5. Databricks Connect setup