Skip to main content

CLI tool to run Databricks notebooks from local git repos

Project description

mimi-dbx-runner

CLI tool to run Databricks notebooks from local git repos.

Install

pip install -e /path/to/mimi-dbx-runner

Setup

Create a .env in your project directory (see .env.example):

DATABRICKS_HOST=https://your-workspace.cloud.databricks.com
DATABRICKS_TOKEN=dapi...
DATABRICKS_CLUSTER_ID=xxxx-xxxxxx-xxxxxxxx
DBX_UPLOAD_PATH=/Users/your.email@company.com/dbx_runner_tmp

Usage

dbx-run <notebook_path> [options]

Options:
  -p, --param KEY=VALUE    Widget parameter (repeatable)
  --cluster-id ID          Override DATABRICKS_CLUSTER_ID
  --no-cleanup             Keep uploaded notebook in workspace
  --upload-path PATH       Override DBX_UPLOAD_PATH

Examples

dbx-run my_notebook.py -p client_name=acme
dbx-run analysis.ipynb -p start_date=2024-01-01 --no-cleanup
python -m mimi_dbx_runner notebook.py -p key=value

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mimi_dbx_runner-0.2.1.tar.gz (7.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mimi_dbx_runner-0.2.1-py3-none-any.whl (9.2 kB view details)

Uploaded Python 3

File details

Details for the file mimi_dbx_runner-0.2.1.tar.gz.

File metadata

  • Download URL: mimi_dbx_runner-0.2.1.tar.gz
  • Upload date:
  • Size: 7.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for mimi_dbx_runner-0.2.1.tar.gz
Algorithm Hash digest
SHA256 0ba4ec310a20a710ce472370b30f7cbbf9a708818d11ab431ef26e7e31331c89
MD5 bb4f3e9bbbbf214f24bc3151e83dd806
BLAKE2b-256 445a08c35856a4b04e6061a77fa5655cbfe2a2c90e9ffe653b4f4d9d874cd21a

See more details on using hashes here.

File details

Details for the file mimi_dbx_runner-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for mimi_dbx_runner-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7cc03f737d2643cfa5942524d41302439a883000453bc258bcef79982ac696a4
MD5 5997258fcfa7f5ed77bbdf19cb825906
BLAKE2b-256 31ffe77d8f8efbe95a927a956ff508bda4af15878dbd52a9e702534e2b9e4f16

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page