airflow-supervisor
Run and monitor supervisord-managed jobs from Apache Airflow.
from airflow import DAG
from airflow_supervisor import ProgramConfiguration, Supervisor, SupervisorAirflowConfiguration
dag = DAG(dag_id="nightly-supervisor", schedule="@daily")
config = SupervisorAirflowConfiguration(
working_dir="/var/tmp/nightly-supervisor",
program={
"nightly": ProgramConfiguration(command="python /opt/jobs/nightly.py"),
},
)
Supervisor(dag=dag, cfg=config)
The generated lifecycle creates a dedicated supervisord instance, starts and
monitors programs with airflow-ha, handles retriggers, and optionally stops and
removes the instance. SupervisorSSH manages the same lifecycle remotely.
Documentation
- Tutorial: run a supervised job from Airflow
- How-to guides
- Why Airflow delegates process ownership
- API reference
Published documentation is available at airflow-laminar.github.io/airflow-supervisor.
Ecosystem
- supervisor-pydantic supplies supervisord models and lifecycle tools.
- systemd-pydantic and cron-pydantic model alternative runtimes.
- airflow-systemd provides the analogous systemd lifecycle.
- airflow-cron converts cron jobs into ordinary Airflow tasks.
- airflow-pydantic supplies declarative task, host, and connection models.
- airflow-config produces YAML-driven DAGs.
[!NOTE] This library was generated using copier from the Base Python Project Template repository.
1 maintainer
Metadata
1 maintainer
Release files for airflow-supervisor 1.10.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| airflow_supervisor-1.10.4.tar.gz | 20.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| airflow_supervisor-1.10.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 52.6 kB
Release files / airflow_supervisor-1.10.4.tar.gz
| Download URL | airflow_supervisor-1.10.4.tar.gz |
|---|---|
| Size | 20.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5e403ecf70e6b76139a9acbc159e450d235e66686ac9be8c3fce0b603f2ff852
|
|
BLAKE2b-256 checksum How to use checksums |
b17ee6962b1833e2a5d0273b5edf82a1170e5641b1c5c2326bb36d02d658752a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
Release files / airflow_supervisor-1.10.4-py3-none-any.whl
| Download URL | airflow_supervisor-1.10.4-py3-none-any.whl |
|---|---|
| Size | 31.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1634bfee059a3a9d41eae0a83b23b4ebd6a99acaf4e8f21fbb3f7427e0ff118a
|
|
BLAKE2b-256 checksum How to use checksums |
05a5fbf7f568f3cc36652ee26677290ed8b09113da6cc59f75501767410e01ee
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.13
|
