dpone-airflow-pack
dpone-airflow-pack is the lightweight, Airflow-independent reader and DAG
construction library for dpone GitOps packs. The formal
apache-airflow-providers-dpone distribution owns provider discovery and the
canonical airflow.providers.dpone namespace.
It only reads a static airflow-pack.json and builds visible Airflow/Kubernetes tasks. It does not import the full
dpone runtime and intentionally contains no source/sink/native transfer dependencies such as ClickHouse, MSSQL,
pyodbc, pandas, polars, or ConnectorX.
Recommended zero-boilerplate Airflow DAG import:
from airflow.providers.dpone import load_dpone_dags
report = load_dpone_dags(
globals(),
index_path="/opt/airflow/dags/.dpone-cache/current/airflow-index.json",
)
The formal provider's canonical namespace is PEP 561 typed.
DponeDag.from_spec(...) and
DponeTaskGroup.from_pack(...) remain typed escape hatches for hybrid DAGs.
The old dpone_airflow_pack imports remain compatibility shims and emit one
deprecation warning per process for provider-facade objects.
For remote immutable packs, keep DAG parsing cache-only:
dpone-airflow-pack-sync \
--once \
--index-uri s3://bucket/dpone-artifacts/prod/repo/latest/pack-index.json \
--reader-connection-id s3_dpone_artifacts_reader \
--cache-dir /opt/airflow/dags/.dpone-cache/airflow
dpone-airflow-pack-cache-status \
--cache-dir /opt/airflow/dags/.dpone-cache/airflow \
--json
The loader reads only the local composite deployment index and its listed checksum-verified DAG specs/packs. It does not scan authoring sources, refresh a remote cache, or read Airflow Variables, Connections, Vault, Kubernetes, or a metadata database during parse.
For DAGs that should run a whole GitOps domain or a named workflow group, keep the grouping in the domain catalog and resolve it through the lightweight provider:
workflow_groups:
daily:
workload_ids:
- dim_customer
- fact_order
from dpone_airflow_pack import workload_ids_from_gitops_domain
workload_ids = workload_ids_from_gitops_domain(
repo_root,
"sales",
group="daily",
)
The resolver only reads YAML files and validates that every group member exists in the same domain catalog.
The full dpone[full,accel] package belongs in the KPO runtime image, not in the scheduler image.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dpone_airflow_pack-0.73.0.tar.gz.
File metadata
- Download URL: dpone_airflow_pack-0.73.0.tar.gz
- Upload date:
- Size: 55.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d9e2acd9b736bedca7f9856f6f67ba8a917a0901983d2f84d2146c5f0d66a192
|
|
| MD5 |
481c363e03181cb5d586e859194efef0
|
|
| BLAKE2b-256 |
6f9934e73aad0d01cda61008a7e64a23776e8975ec298268df4d85370d944329
|
File details
Details for the file dpone_airflow_pack-0.73.0-py3-none-any.whl.
File metadata
- Download URL: dpone_airflow_pack-0.73.0-py3-none-any.whl
- Upload date:
- Size: 77.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8aa0bbbf016c200919519b9be184cfb58c2522eea903c2c8e660a7802257ae91
|
|
| MD5 |
6bea9fc51f544bdbc7ae0902e057c977
|
|
| BLAKE2b-256 |
d70de39aadfa98bcf1bfc84752b38fc4bfca29eb549bd3dfc2ccc2372aeb4f1d
|
