etlantic-airflow
Release status: ETLantic 0.59.0 is a Beta release candidate; publication is pending.
Airflow reference orchestrator compiler for ETLantic 0.57.
Note: This plugin and ETLantic core use Beta classifiers for documented single-tenant pilots. Classifiers are not an enterprise SLA.
Install
pip install etlantic-airflow
# To import generated DAGs into an Airflow process, install apache-airflow
# separately in the Airflow environment (not required for compile).
Wiring
from etlantic import Profile, plan_pipeline, compile_plan
profile = Profile(
name="airflow-prod",
orchestrator="airflow",
schedule={"type": "cron", "expression": "0 2 * * *", "timezone": "UTC"},
execution={"retries": 2, "timeout_seconds": 3600},
)
plan = plan_pipeline(MyPipeline, profile=profile)
artifact = compile_plan(plan, target="airflow", profile=profile)
artifact.write("dags/my_pipeline.py")
The etlantic.orchestrator_plugins entry point named airflow registers
etlantic_airflow:create_plugin. Set orchestrator="airflow" in the profile,
validate and plan first, then compile the valid plan with
etlantic compile TARGET --target airflow -o dags/.
Capabilities
- Deterministic Airflow DAG module generation from a secret-free
PipelinePlan - Schedule, retry, timeout, and dependency mapping
- Retry-safety fail-closed for unsafe sinks
- Artifact-ref-only XCom payloads (no large inline data)
- Lifecycle correlation keys for normalized run reports
Not included: managed Airflow deployments, Dagster compile plugins, or
Prefect (shipped separately as an ExecutionScheduler local MVP, not as an
Airflow-style compiler).
Links
1 maintainer
Metadata
1 maintainer
Release files for etlantic-airflow 0.59.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| etlantic_airflow-0.59.0.tar.gz | 7.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| etlantic_airflow-0.59.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 16.4 kB
Release files / etlantic_airflow-0.59.0.tar.gz
| Download URL | etlantic_airflow-0.59.0.tar.gz |
|---|---|
| Size | 7.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
02e5b3e793a710644b0b1e6802f5c3818a3eed47d46eb026cb2141a2485d7b8f
|
|
BLAKE2b-256 checksum How to use checksums |
3a45312307304db9f2e0e0ffd1b503d5fcfdb4ebab4a6fc4ddfcd2c91794788a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / etlantic_airflow-0.59.0-py3-none-any.whl
| Download URL | etlantic_airflow-0.59.0-py3-none-any.whl |
|---|---|
| Size | 9.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
916ccd53d8c854766d32685217e4c6ba8ba2a4e7aa7cdd64e5bbf12be575fe64
|
|
BLAKE2b-256 checksum How to use checksums |
68851873d2a427a39df0e584d451681dd2ba4211442d9899e8a12fc12d87fc71
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
