airflow-common

Common operators and tasks for Airflow

Overview

airflow-common provides common operators, topology helpers, and library management tasks for Apache Airflow workflows.

Key features:

• Common Operators: Convenience operators like Skip, Fail, and Pass for workflow control
• Topology Helpers: Functions like all_success_any_failure and if_booted_do for building complex DAG topologies
• Library Management: Pydantic models for PipLibrary, CondaLibrary, and GitRepo with corresponding operators for package installation
• Infrastructure Tasks: Operators for system maintenance like JournalctlClean

[!NOTE] This library is built on airflow-pydantic for Pydantic-based Airflow constructs, and integrates seamlessly with airflow-config for YAML-driven DAG definitions using Hydra.

Installation

You can install from pip:

pip install airflow-common

Or via conda:

conda install airflow-common -c conda-forge

License

This software is licensed under the Apache 2.0 license. See the LICENSE file for details.

[!NOTE] This library was generated using copier from the Base Python Project Template repository.