A tool to manage Airflow dags.
Project description
airflow-dag
A tool to manage Airflow dags.
Installation
You can use pip
to install airflow-dag
:
$ pip install airflow-dag
Usage
You can use the build
command to convert a yaml config to an Airflow dag:
$ airflow-dag build -t examples/ -c examples/notebook.yml -o examples/out
$ airflow-dag build --help
Usage: airflow-dag build [OPTIONS]
Convert a yaml config to an Airflow dag.
Options:
-t, --template-dir TEXT Path to dag templates
-c, --config TEXT Path to dag config
-o, --output-dir TEXT Output path
--help Show this message and exit.
If a template path is not provided, airflow-dag
will look into the default templates.
You can define your own dag templates too, and put them in a templates
directory in Airflow's home folder. The dag yaml configs can be placed in a configs
directory in the same home folder, and the output path can then be the Airflow dags folder. The usage will look like:
$ airflow-dag build -t airflow/templates -c airflow/configs/dag.yml -o airflow/dags
Versioning
airflow-dag
uses Semantic Versioning. For the available versions, see the tags on the GitHub repository.
License
This project is licensed under the Apache License, see the LICENSE file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file airflow-dag-0.1.0.tar.gz
.
File metadata
- Download URL: airflow-dag-0.1.0.tar.gz
- Upload date:
- Size: 3.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | de16ce07256456a7845163849b724aade3e3124856082a3ac84fd35de636b83b |
|
MD5 | dcaf386a6e8262cbfeb99d99c32e9b65 |
|
BLAKE2b-256 | 63c227fe8b9136a32d93b7a5f42224c3d9745b0760805ca1f2b52a20ece494ba |
File details
Details for the file airflow_dag-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: airflow_dag-0.1.0-py3-none-any.whl
- Upload date:
- Size: 8.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/44.0.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cac8c137bc75527b14fe67b476dbe28374fde2bb234916455a3fe2e5cdb435bd |
|
MD5 | d960fbf3d811502940fb1b69920824bd |
|
BLAKE2b-256 | e08d9428b0c397d142563bebe50b6a221ab8f0b63b236a17bd3b5bbd57785b5f |