Framework with task testing over Apache Airflow
Project description
Data Detective Airflow
Data Detective Airflow is a framework whose main idea is to add the concepts of work and result to Apache Airflow. It supports tasks testing over Apache Airflow. Data Detective Airflow allows developers to create workflows in the form of directed acyclic graphs (DAGs) of tasks. The easy-to-use Data Detective Airflow scheduler makes it possible to run tasks and save results into works. Work storage support for s3, ftp, local disk and database is also included.
More information about Data Detective Airflow
Installation
Install from PyPi
pip install data-detective-airflow
See example DAG-s in dags/dags folder.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file data_detective_airflow-2.2.0.tar.gz.
File metadata
- Download URL: data_detective_airflow-2.2.0.tar.gz
- Upload date:
- Size: 34.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.9.16 Linux/5.15.0-1038-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fa30ed3b64e9904639b5d2303148cff4557b4c865228263c20219b20113298e7 |
|
| MD5 | d0b267985fc0c83ada3533989b5ca1d1 |
|
| BLAKE2b-256 | b693a847daa559f9404602c4196c900eeabfc79c8f9791ba1a6271c400db91ab |
File details
Details for the file data_detective_airflow-2.2.0-py3-none-any.whl.
File metadata
- Download URL: data_detective_airflow-2.2.0-py3-none-any.whl
- Upload date:
- Size: 59.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.2.2 CPython/3.9.16 Linux/5.15.0-1038-azure
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | f21726d066f2cf1ba233468f735880de4a9f7374d2cf53a39818eb99d9a0736b |
|
| MD5 | a6c52a37d3b04efb5bad4420b8674856 |
|
| BLAKE2b-256 | 06ab17751ded34f4fbb90cba0bbb503a2e5c1d9ba7b80c6b239cb679d0a738fd |
