Simple data processing (ETL) library with support for multi-processing
Project description
Python Simple Flow
- Simple framework with a defined structure for data processing with support for multi-process
- Data processing flow is split into four phases:
- Source: Fetch the data from a source
- Ingress: Register the data received, log or in DB for trace-ability
- Transform: Business logic of transforming the data to your business needs
- Egress: Push the data to downstream or your storage
- Processing can be done in one process, like running it in-process or in multi processing mode
- Mode to be chosen depends on the task you are doing
- Easy setting up logger even in multi processing mode
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for py_simple_flow-2020.5.31-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 927c78d44022ec6451c8ed029ece496df2b91a7886090eb2aa4ce3e7d2d5d011 |
|
MD5 | 591a84623d9d54165f34ccda0c65dac7 |
|
BLAKE2b-256 | 66c20c3a0c6f3f06ad0489e2630e8850c65494720e5ec17bc3a10a61b4252972 |