airflow-supervisor
Run and monitor supervisord-managed jobs from Apache Airflow.
from airflow import DAG
from airflow_supervisor import ProgramConfiguration, Supervisor, SupervisorAirflowConfiguration
dag = DAG(dag_id="nightly-supervisor", schedule="@daily")
config = SupervisorAirflowConfiguration(
working_dir="/var/tmp/nightly-supervisor",
program={
"nightly": ProgramConfiguration(command="python /opt/jobs/nightly.py"),
},
)
Supervisor(dag=dag, cfg=config)
The generated lifecycle creates a dedicated supervisord instance, starts and
monitors programs with airflow-ha, handles retriggers, and optionally stops and
removes the instance. SupervisorSSH manages the same lifecycle remotely.
Documentation
- Tutorial: run a supervised job from Airflow
- How-to guides
- Why Airflow delegates process ownership
- API reference
Published documentation is available at airflow-laminar.github.io/airflow-supervisor.
Ecosystem
- supervisor-pydantic supplies supervisord models and lifecycle tools.
- systemd-pydantic and cron-pydantic model alternative runtimes.
- airflow-systemd provides the analogous systemd lifecycle.
- airflow-cron converts cron jobs into ordinary Airflow tasks.
- airflow-pydantic supplies declarative task, host, and connection models.
- airflow-config produces YAML-driven DAGs.
[!NOTE] This library was generated using copier from the Base Python Project Template repository.
Install the Python Templates Copier Update GitHub App to receive weekly template update pull requests.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file airflow_supervisor-1.10.3.tar.gz.
File metadata
- Download URL: airflow_supervisor-1.10.3.tar.gz
- Upload date:
- Size: 20.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d1eb4ecfabcdd54539128e2f11469b6bf0d5bf9618c86ba4c7e66605f0138976
|
|
| MD5 |
f3e3b9bf8147edb7f834641de31a37fa
|
|
| BLAKE2b-256 |
79916dbd4878153eab0188929061c37a145137b34a1264bb45175110cbac9cf9
|
File details
Details for the file airflow_supervisor-1.10.3-py3-none-any.whl.
File metadata
- Download URL: airflow_supervisor-1.10.3-py3-none-any.whl
- Upload date:
- Size: 32.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
aaf07ad9ae359b726ba43d96069a66025438784b1d1b01698113806052a91dca
|
|
| MD5 |
f1a832dced8e7b8508002e0b572ee40e
|
|
| BLAKE2b-256 |
677453c2792ace706dbd51855427f4af2bc626724766155995ec4e2eeb3a404c
|
