airflow-config
Declarative Apache Airflow DAGs from Hydra YAML and airflow-pydantic models.
# config/pipeline.yaml
# @package _global_
_target_: airflow_config.Configuration
dags:
daily-report:
schedule: "0 6 * * *"
start_date: "2025-01-01"
catchup: false
tasks:
report:
_target_: airflow_config.BashTask
bash_command: python /opt/jobs/report.py
from airflow_config import load_config
config = load_config("config", "pipeline")
config.generate_in_mem()
Configuration can provide shared defaults, environment overrides, templates, extensions, generated Python DAG files, or in-memory DAG registration.
Documentation
- Tutorial: generate a DAG from YAML
- How-to guides
- Why configuration and DAG models are separate
- API reference
Published documentation is available at airflow-laminar.github.io/airflow-config.
Ecosystem
- airflow-pydantic supplies the DAG, task, sensor, schedule, pool, and variable models.
- airflow-supervisor and supervisor-pydantic manage supervisord jobs.
- airflow-systemd and systemd-pydantic manage systemd services.
- airflow-cron and cron-pydantic convert crontabs into DAG models.
- airflow-balancer supplies host and port selection extensions.
- airflow-common supplies common operators and library management.
[!NOTE] This library was generated using copier from the Base Python Project Template repository.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file airflow_config-1.12.3.tar.gz.
File metadata
- Download URL: airflow_config-1.12.3.tar.gz
- Upload date:
- Size: 198.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f48d8d76a138d454836478c81ae7e522638c6cf09d50619ca3c7ae87c1cdf42a
|
|
| MD5 |
4e0e500b48cb22a0259d2ed070f8be1f
|
|
| BLAKE2b-256 |
c0d69d91c12dac38d841d6fcca0d1be3ea0e530c139425c733fde2b3d5510ecb
|
File details
Details for the file airflow_config-1.12.3-py3-none-any.whl.
File metadata
- Download URL: airflow_config-1.12.3-py3-none-any.whl
- Upload date:
- Size: 193.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bd2a6fb5a2a57405d291f4b07859503c6bfbcf2a003189eaa4d4abe5ca4eac5d
|
|
| MD5 |
c87271aea6f2c0a43b9bb26cefa98569
|
|
| BLAKE2b-256 |
b6d46f7a8665f8ead87aba9f7ebf0183f68e5b7333ee407e43e1944096953e59
|
