Skip to main content

Lightweight Airflow scheduler-side pack provider for dpone GitOps workloads

Project description

dpone-airflow-pack

dpone-airflow-pack is the lightweight Airflow scheduler/webserver provider for dpone GitOps packs.

It only reads a static airflow-pack.json and builds visible Airflow/Kubernetes tasks. It does not import the full dpone runtime and intentionally contains no source/sink/native transfer dependencies such as ClickHouse, MSSQL, pyodbc, pandas, polars, or ConnectorX.

Recommended Airflow DAG import:

from dpone_airflow_pack import build_dpone_gitops_task_group_from_pack

The full dpone[full,accel] package belongs in the KPO runtime image, not in the scheduler image.

Airflow execution policy

airflow-pack.json can carry a scheduler-side execution policy:

{
  "airflow": {
    "execution": {
      "task_executor": "KubernetesExecutor",
      "deferrable": true,
      "on_finish_action": "delete_succeeded_pod"
    }
  }
}

The lightweight provider maps it to KubernetesPodOperator kwargs (executor, deferrable, on_finish_action) and treats those fields as pack-owned. DAG-local overrides may still set DAG-owned values such as retries, pool, get_logs, or in_cluster.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dpone_airflow_pack-0.65.1.tar.gz (14.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dpone_airflow_pack-0.65.1-py3-none-any.whl (21.3 kB view details)

Uploaded Python 3

File details

Details for the file dpone_airflow_pack-0.65.1.tar.gz.

File metadata

  • Download URL: dpone_airflow_pack-0.65.1.tar.gz
  • Upload date:
  • Size: 14.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for dpone_airflow_pack-0.65.1.tar.gz
Algorithm Hash digest
SHA256 ce220e5e90fd055af943de7c1b598b365b9473d087523a8ae74128e0eb2a41f3
MD5 685aa8c3c1a1727f7b0481602da0cf97
BLAKE2b-256 96c54fee940012f188526d952d3085904b9d928bb79c25eb19bc6337dd6c3c9d

See more details on using hashes here.

File details

Details for the file dpone_airflow_pack-0.65.1-py3-none-any.whl.

File metadata

File hashes

Hashes for dpone_airflow_pack-0.65.1-py3-none-any.whl
Algorithm Hash digest
SHA256 924464baf1777108c47a57aaaf4847398ff0d4667426bec17542509403dc6edb
MD5 deddd6c8371c110d140e046bfa545103
BLAKE2b-256 b673b7c580b348cb3e08ec744834f098cd75af92dcf54f482f81c3840e420905

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page