aksdp
Overview
A simple framework for writing data pipelines in Python
INSTALL
$ pip install aksdp
QuickStart
class TaskA(Task):
def main(self, ds):
return ds
class TaskB(Task):
...
class TaskC(Task):
...
class TaskD(Task):
...
graph = Graph()
task_a = graph.append(TaskA())
task_b = graph.append(TaskB(), [task_a])
task_c = graph.append(TaskC(), [task_b])
task_d = graph.append(TaskD(), [task_b, task_c])
graph.run()
Each task runs after each dependent task completes.
Also, the data output upstream can be received as input data and processed.
Release files for aksdp 0.0.1.post6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| aksdp-0.0.1.post6.tar.gz | 13.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| aksdp-0.0.1.post6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 33.8 kB
Release files / aksdp-0.0.1.post6.tar.gz
| Download URL | aksdp-0.0.1.post6.tar.gz |
|---|---|
| Size | 13.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6ce48624d5b469bdbb0054a1b8b94943fa48c4213397be23a75df63b3176eb47
|
|
BLAKE2b-256 checksum How to use checksums |
39a222dd5bb722abfb807b9e557c9d36b00881661f21f9d2134f1ce86d1f795e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.0.9 CPython/3.7.7 Linux/5.3.0-1028-aws
|
Release files / aksdp-0.0.1.post6-py3-none-any.whl
| Download URL | aksdp-0.0.1.post6-py3-none-any.whl |
|---|---|
| Size | 20.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
40baf2053733f308e64ec188eeef09c3af91c50166cd87f4adf411c369475741
|
|
BLAKE2b-256 checksum How to use checksums |
02bf7c4fcde12e9bb5cd0950afa76e261ee973d89dce1ef74e94470596a430d8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.0.9 CPython/3.7.7 Linux/5.3.0-1028-aws
|