Simple DataPipeline Library
Project description
aksdp
Overview
A simple framework for writing data pipelines in Python
INSTALL
$ pip install aksdp
QuickStart
class TaskA(Task):
def main(self, ds):
return ds
class TaskB(Task):
...
class TaskC(Task):
...
class TaskD(Task):
...
graph = Graph()
task_a = graph.append(TaskA())
task_b = graph.append(TaskB(), [task_a])
task_c = graph.append(TaskC(), [task_b])
task_d = graph.append(TaskD(), [task_b, task_c])
graph.run()
Each task runs after each dependent task completes.
Also, the data output upstream can be received as input data and processed.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
aksdp-0.0.1.post5.tar.gz
(12.9 kB
view hashes)
Built Distribution
Close
Hashes for aksdp-0.0.1.post5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d046406a68e47be0f14c0bbfe0bc6bb129535be37dd91a586b6b787509b8b6d |
|
MD5 | dcd4bfea222186616473524f5fed1ca3 |
|
BLAKE2b-256 | 601032510bd39187313b7d681d47bdb7b4c502c73e9561d1edc1459d009316f3 |