Simple data processing (ETL) library with support for multi-processing
Project description
Python Simple Flow
- Simple framework with a defined structure for data processing with support for multi-process
- Data processing flow is split into four phases:
- Source: Fetch the data from a source
- Ingress: Register the data received, log or in DB for trace-ability
- Transform: Business logic of transforming the data to your business needs
- Egress: Push the data to downstream or your storage
- Processing can be done in one process, like running it in-process or in multi processing mode
- Mode to be chosen depends on the task you are doing
- Easy setting up logger even in multi processing mode
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for py_simple_flow-2020.8.23-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0f24e95f2ddf39aa22801d002403df176a2f6d2b52b4f4c55321b618c6f51876 |
|
MD5 | 16cd03e583c8ea8bff07c99151517efb |
|
BLAKE2b-256 | 1509d16ec99833acf760b5cd58c0d4a4447378095774bdb3f28749ea21f8980b |