Yanked

This release has been yanked by its maintainers, and will be ignored by installers, except when explicitly specified.
Consider using release 5.0.4 instead.
Reason given by maintainers: Wrong version pins

awehflow

coverage report pipeline status

awehflow is a configuration-driven framework for Apache Airflow that dynamically generates DAGs from simple HOCON or YAML files. It comes with built-in metrics, logging, and alerting to streamline your data orchestration.

Core Concepts

  • Configuration-Driven: Define complex DAGs using a clear, hierarchical configuration. No need to write repetitive Python code for each pipeline.
  • Dynamic DAG Generation: awehflow automatically constructs and orchestrates Airflow DAGs based on your configurations.
  • Built-in Observability: Comes with out-of-the-box event handlers for persisting metrics to a database and alerters for notifications on pipeline status.
  • Extensible: Easily add your own custom event handlers and alerters to integrate with any service.

Getting Started

Configuration Reference

Custom Operators and Sensors

awehflow includes a collection of custom operators and sensors to extend Airflow's functionality. While these custom operators provide specialized capabilities, awehflow is fully compatible with all standard Airflow operators. You can use any operator available in your Airflow environment by referencing its fully qualified class name in your configuration.

Command-Line Interface (CLI)

awehflow includes a CLI for generating and validating configurations.

Advanced Features

Event Handlers & Alerters

awehflow has a built-in event system that allows you to run custom code in response to pipeline events. Alerters are a special type of event handler designed for sending notifications.

  • Alerts Guide: A detailed guide on how to configure and use alerters.

Troubleshooting

For Developers

Development Environment Setup

To contribute to awehflow, follow these steps to set up a development environment for a specific Airflow version.

  1. Install Miniconda: Follow the official instructions.
  2. Create Conda Environment (x86 on Mac ARM): If you are on an ARM-based Mac, create an x86-emulated environment. Add this function to your `.zsh

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
  • Yanked:
Newer release available (5.0.4)

3 maintainers

PyPI data
Data sourced directly from PyPI's database.
Avatar for cronje.fourie from gravatar.com cronje.fourie Avatar for pietervdw from gravatar.com pietervdw Avatar for prperold from gravatar.com prperold

License

Spatialedge Community License Version 1.0 This Spatialedge Community License Agreement Version 1.0 (...

Requires

Python >=3.10

Provides Extra

default composer

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

awehflow-5.0.0.tar.gz (43.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

awehflow-5.0.0-py3-none-any.whl (46.0 kB view details)

Uploaded Python 3

File details

Details for the file awehflow-5.0.0.tar.gz.

File metadata

  • Download URL: awehflow-5.0.0.tar.gz
  • Upload date:
  • Size: 43.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for awehflow-5.0.0.tar.gz
Algorithm Hash digest
SHA256 35c454b33cdff5702934b227cc34a042235a6867693c3242abd5870b0c4465fc
MD5 ea15f70196dfa7d1ea3aa2cde3bdc68a
BLAKE2b-256 0487fad6d470942a4d7843a1d1ac65fef455fd716ffd9afae28b4c9ec17f26d5

See more details on using hashes here.

File details

Details for the file awehflow-5.0.0-py3-none-any.whl.

File metadata

  • Download URL: awehflow-5.0.0-py3-none-any.whl
  • Upload date:
  • Size: 46.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for awehflow-5.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b0dc1043c23411cc79778f530b411af941e4674f50dfa073e20a284e50c37f2d
MD5 1ba5292718e3e4ccc18c90a9592b8b71
BLAKE2b-256 f5da65095b73747561aea5591f96a72e958d0645decbe167a6b20ae2a259c2c4

See more details on using hashes here.

Release history Release notifications | RSS feed

5.0.4

2 files

5.0.3

2 files

5.0.2

2 files

5.0.1

2 files

This release
Yanked

5.0.0 This release

2 files

Yanked reason: Wrong version pins

4.0.7

2 files

4.0.6

2 files

4.0.5

2 files

Yanked

4.0.4

2 files

Yanked reason: Race condition on SFTP metadata check

4.0.3

2 files

4.0.2

2 files

4.0.1

2 files

Yanked

4.0.0

2 files

Yanked reason: Deprecated BigQueryHook.get_service() used

3.2.0

2 files

3.1.1

2 files

Yanked

3.1.0

2 files

Yanked reason: Install only installs CLI

3.0.6

2 files

3.0.5

2 files

3.0.4

2 files

3.0.3

2 files

3.0.2

2 files

3.0.1

2 files

3.0.0

2 files

2.4.3.3

2 files

2.4.3.2

2 files

2.4.3.1

2 files

2.4.3.0

2 files

2.2.3.2

2 files

2.2.3.1

2 files

2.2.3.0

2 files

2.1.4.6.7

2 files

2.1.4.6.6

2 files

2.1.4.6.5

2 files

2.1.4.6.4

2 files

2.1.4.6.3

2 files

2.1.4.6.2

2 files

2.1.4.6.1

2 files

2.1.4.6.0

2 files

2.1.4.5

2 files

2.1.4.4

2 files

2.1.4.3

2 files

2.1.4.2

2 files

2.1.4.1

2 files

2.1.4.0

2 files

2.1.2.0

2 files

1.10.15.1

2 files

1.10.15.0

2 files

1.10.9.10

2 files

1.10.9.9

2 files

1.10.9.8

2 files

1.10.9.7

2 files

1.10.9.6

2 files

1.10.9.5

2 files

1.10.9.4

2 files

1.10.9.3

2 files

1.10.9.2

2 files

1.10.9.1

2 files

1.10.9.0

2 files

1.10.6.3

2 files

1.10.6.2

2 files

1.10.6.1

2 files

1.10.3.0

2 files

1.10.2.1

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page