Skip to main content

CLI tool to run Databricks notebooks from local git repos

Project description

mimi-dbx-runner

CLI tool to run Databricks notebooks from local git repos.

Install

pip install -e /path/to/mimi-dbx-runner

Setup

Create a .env in your project directory (see .env.example):

DATABRICKS_HOST=https://your-workspace.cloud.databricks.com
DATABRICKS_TOKEN=dapi...
DATABRICKS_CLUSTER_ID=xxxx-xxxxxx-xxxxxxxx
DBX_UPLOAD_PATH=/Users/your.email@company.com/dbx_runner_tmp

Usage

dbx-run <notebook_path> [options]

Options:
  -p, --param KEY=VALUE    Widget parameter (repeatable)
  --cluster-id ID          Override DATABRICKS_CLUSTER_ID
  --no-cleanup             Keep uploaded notebook in workspace
  --upload-path PATH       Override DBX_UPLOAD_PATH

Examples

dbx-run my_notebook.py -p client_name=acme
dbx-run analysis.ipynb -p start_date=2024-01-01 --no-cleanup
python -m mimi_dbx_runner notebook.py -p key=value

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mimi_dbx_runner-0.2.0.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mimi_dbx_runner-0.2.0-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file mimi_dbx_runner-0.2.0.tar.gz.

File metadata

  • Download URL: mimi_dbx_runner-0.2.0.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for mimi_dbx_runner-0.2.0.tar.gz
Algorithm Hash digest
SHA256 14aefcb0915d4291af27052f0437aefd39ce2204900ed1e133de480e9b84b7ad
MD5 888cba16eef30509ba341894afc85e77
BLAKE2b-256 b683b466734f38880f3e56356093b1d30c75c8197b747a1e32be940e95206cd5

See more details on using hashes here.

File details

Details for the file mimi_dbx_runner-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mimi_dbx_runner-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 34b5c99ada0cb87c30edd89fe442e76e83c16bd32c230f6595cb5cf243831d75
MD5 46bbe8fd73080f8141bf6890a1c767b5
BLAKE2b-256 b70a677f5f295bbab952f8d5476efbb8f5e5d47e35cc546161b45bec38cb73c8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page