Skip to main content

A tool to manage Airflow dags.

Project description

airflow-dag

A tool to manage Airflow dags.

Installation

You can use pip to install airflow-dag:

$ pip install airflow-dag

Usage

You can use the build command to convert a yaml config to an Airflow dag:

$ airflow-dag build -t examples/ -c examples/notebook.yml -o examples/out
$ airflow-dag build --help
Usage: airflow-dag build [OPTIONS]

  Convert a yaml config to an Airflow dag.

Options:
  -t, --template-dir TEXT  Path to dag templates
  -c, --config TEXT        Path to dag config
  -o, --output-dir TEXT    Output path
  --help                   Show this message and exit.

If a template path is not provided, airflow-dag will look into the default templates.

You can define your own dag templates too, and put them in a templates directory in Airflow's home folder. The dag yaml configs can be placed in a configs directory in the same home folder, and the output path can then be the Airflow dags folder. The usage will look like:

$ airflow-dag build -t airflow/templates -c airflow/configs/dag.yml -o airflow/dags

Versioning

airflow-dag uses Semantic Versioning. For the available versions, see the tags on the GitHub repository.

License

This project is licensed under the Apache License, see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

airflow-dag-0.1.0.tar.gz (3.6 kB view details)

Uploaded Source

Built Distribution

airflow_dag-0.1.0-py3-none-any.whl (8.0 kB view details)

Uploaded Python 3

File details

Details for the file airflow-dag-0.1.0.tar.gz.

File metadata

  • Download URL: airflow-dag-0.1.0.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

File hashes

Hashes for airflow-dag-0.1.0.tar.gz
Algorithm Hash digest
SHA256 de16ce07256456a7845163849b724aade3e3124856082a3ac84fd35de636b83b
MD5 dcaf386a6e8262cbfeb99d99c32e9b65
BLAKE2b-256 63c227fe8b9136a32d93b7a5f42224c3d9745b0760805ca1f2b52a20ece494ba

See more details on using hashes here.

File details

Details for the file airflow_dag-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: airflow_dag-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 8.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

File hashes

Hashes for airflow_dag-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cac8c137bc75527b14fe67b476dbe28374fde2bb234916455a3fe2e5cdb435bd
MD5 d960fbf3d811502940fb1b69920824bd
BLAKE2b-256 e08d9428b0c397d142563bebe50b6a221ab8f0b63b236a17bd3b5bbd57785b5f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page