Skip to main content

Framework with task testing over Apache Airflow

Project description

Data Detective Airflow

Data Detective Airflow is a framework whose main idea is to add the concepts of work and result to Apache Airflow. It supports tasks testing over Apache Airflow. Data Detective Airflow allows developers to create workflows in the form of directed acyclic graphs (DAGs) of tasks. The easy-to-use Data Detective Airflow scheduler makes it possible to run tasks and save results into works. Work storage support for s3, ftp, local disk and database is also included.

More information about Data Detective Airflow

Installation

Install from PyPi

pip install data-detective-airflow

See example DAG-s in dags/dags folder.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

data_detective_airflow-2.2.0.tar.gz (34.7 kB view hashes)

Uploaded Source

Built Distribution

data_detective_airflow-2.2.0-py3-none-any.whl (59.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page