benvy 1.2.0.dev3

Daipe framework development environment initializer

Development environment initialization

for the Daipe stack

What it does

Local Computer

• Extends the Pyfony dev environment initialization
• Downloads Hadoop's winutils.exe and puts it into the project's .venv directory (Windows only)
• Downloads Java 1.8 binaries and puts them into the ~/.databricks-connect-java dir
• Creates the empty ~/.databricks-connect file

Databricks Repos Environment

• Download and install poetry package manager
• Install dependencies from poetry.lock
• Set current working directory to project root
• Append src folder to sys path
• Set proper environment variables

Usage

%sh
pip install benvy==1.2.0

from benvy.databricks.repos import bootstrap  # noqa
from benvy.databricks.detector import is_databricks_repo  # noqa

if is_databricks_repo():
    bootstrap.install()

from benvy.databricks.repos import bootstrap  # noqa
from benvy.databricks.detector import is_databricks_repo  # noqa

if is_databricks_repo():
    bootstrap.setup_env()

# %install_master_package_whl