Skip to main content

A microframework for simple ETL solutions

Project description

# Bert A microframework for simple ETL solutions

## Begin with

` $ virtualenv -p $(which python3) env $ source env/bin/activate $ pip install bert-etl $ pip install librosa # for demo project $ docker run -p 6379:6379 -d redis # bert-etl runs on redis to share data across CPUs $ bert-runner.py -n demo $ PYTHONPATH='.' bert-runner.py -m demo -j sync_sounds -f `

## Fund Bounty Target Upgrades

Bert provides a boiler plate framework that’ll allow one to write concurrent ETL code using Pythons’ microprocessing module. One function starts the process, piping data into a Redis backend that’ll then be consumed by the next function. The queues are respectfully named for the scope of the function: Work(start) and Done(end) queue. Please consider contributing to Bert Bounty Targets to improve this documentation

https://www.patreon.com/jbcurtin

## More to come Documentation is being worked on

Project details


Release history Release notifications | RSS feed

This version

0.2.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bert-etl-0.2.0.tar.gz (8.6 kB view details)

Uploaded Source

Built Distribution

bert_etl-0.2.0-py2.py3-none-any.whl (10.3 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file bert-etl-0.2.0.tar.gz.

File metadata

  • Download URL: bert-etl-0.2.0.tar.gz
  • Upload date:
  • Size: 8.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.6.7

File hashes

Hashes for bert-etl-0.2.0.tar.gz
Algorithm Hash digest
SHA256 8217689952c398766a0981f125d5ef58e13ed374b73918e78cbf20dcdda01a1d
MD5 ea6dda9d62eb5fb3935bfd81f0dcdafb
BLAKE2b-256 747d8772c3d2be99568d3fcf5b11acf6356223a779b9e91f31bac93c88347fc2

See more details on using hashes here.

File details

Details for the file bert_etl-0.2.0-py2.py3-none-any.whl.

File metadata

  • Download URL: bert_etl-0.2.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 10.3 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.6.7

File hashes

Hashes for bert_etl-0.2.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 be0a3dc216493920fcbf66db57680591c66b8862ef237ae42b3167bd6fd0f515
MD5 341923ffcf73d5620fa87bb8d0d09c27
BLAKE2b-256 44b1a471bb05be68f7c905f7e650b5d6795cc92e793d21bd9a1e38e6b3d86149

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page