A microframework for simple ETL solutions
Project description
# Bert A microframework for simple ETL solutions
## Begin with
` $ virtualenv -p $(which python3) env $ source env/bin/activate $ pip install bert-etl $ pip install librosa # for demo project $ docker run -p 6379:6379 -d redis # bert-etl runs on redis to share data across CPUs $ bert-runner.py -n demo $ PYTHONPATH='.' bert-runner.py -m demo -j sync_sounds -f `
## Release Notes
### 0.2.1 * Added Release Notes
### 0.2.0
Added Redis Service auto run. Using docker, redis will be pulled and started in the background
Added Redis Service channels, sometimes you’ll want to run to etl-jobs on the same machine
## Fund Bounty Target Upgrades
Bert provides a boiler plate framework that’ll allow one to write concurrent ETL code using Pythons’ microprocessing module. One function starts the process, piping data into a Redis backend that’ll then be consumed by the next function. The queues are respectfully named for the scope of the function: Work(start) and Done(end) queue. Please consider contributing to Bert Bounty Targets to improve this documentation
https://www.patreon.com/jbcurtin
## More to come Documentation is being worked on
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for bert_etl-0.2.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 02a227583bbfd2aac89954855c502375bef1b4b61f01d9adec4684d30a29f1e3 |
|
MD5 | b486e32cabd277f86237032aeac134b4 |
|
BLAKE2b-256 | ebf370b8c0314addd742e8ac1efca83c4d8d979b189498355b23edc216b0fa68 |