Skip to main content

No project description provided

Project description


Drag'n'drop web app to manage and create Airflow DAGs. The goal is to have a Web UI that can generate YML Dag Definitions, integrating with custom operators and potentially existing DAGs. YML DAGs can then be synced to a remote repo

  • Front end is built using Typescript React
  • Back end is built using Flask on Python 3.6+

MVP Required Features

Front-End Features

  • Dynamic Operators
  • Menu Dropdowns
  • Load Operators from App
  • Format operator display into classes
  • Search functionality for operators
  • Basic operator level properties
  • Implement DAG level properties
  • New DAG Functionality
  • Parameter Tooltips
  • Render arbitrary viewport windows for New/Save/Load etc
  • Overwrite/Save prompt on New
  • DAG renaming and save functionality
  • Open dag from menu
  • Check if file already exists on rename
  • Prompt save if there are nodes on open
  • Fix loss of state on refresh bug
  • Icons
  • Put File details in File Browser
  • Pull PORT from Flask host
  • Add a last saved time to NavBar

Back-End Features

  • Generate Operator Lists
  • CLI to start Web and Front End
  • Generate DAG Spec
  • CLI to create new windmill project
  • CLI to start windmill from a windmill project
  • Implement windmill-dev start
  • Save/Load Windmill Files functionality
  • Validate incoming WMLs (is there a need for this?)
  • Get default values
  • Pull parameters from parent classes
  • [?] Dedupe multi import operators - nothing preventing this but underlying issue is fixed
  • Get WML owner and last-modified details during wml list
  • Allow custom operators
  • Add defaults to CLI --help commands
  • Strategy for Python Opjects (e.g. callables) - maybe import statement?
  • Backport existing Python DAGs to WMLs
  • Allow YML updates to propogate to WMLs
  • Allow user specified Airflow Version - isolate to docker or something so we can run 2.7 if we want?

MVP Usage Pattern

To run as a user:

  1. Install with pip install airflow-windmill
  2. Run windmill init to create a local Windmill project
  3. Run windmill run from this folder to run the app locally

To run as a dev:

  1. Clone from git
  2. Run poetry install
  3. ?Run windmill-dev install-node-depts
  4. Run windmill-dev start to start a flask server and use parcel to serve frontend

Future Usage Patterns

  • Auto-sync for windmill project to git

Getting Started

This package can be installed and run using Pip:

pip install windmill-airflow


# Run NPM build
cd windmill/http/app/
npm run-script build

# Update git ...
cd ../../../

# Poetry build
poetry build
poetry publish

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

windmill-airflow-0.0.2.tar.gz (1.5 MB view hashes)

Uploaded source

Built Distribution

windmill_airflow-0.0.2-py3-none-any.whl (1.5 MB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page