Skip to main content

A microframework for simple ETL solutions

Project description

# Bert A microframework for simple ETL solutions

## Begin with

` $ virtualenv -p $(which python3) env $ source env/bin/activate $ pip install bert-etl $ pip install librosa # for demo project $ docker run -p 6379:6379 -d redis # bert-etl runs on redis to share data across CPUs $ bert-runner.py -n demo $ PYTHONPATH='.' bert-runner.py -m demo -j sync_sounds -f `

## Fund Bounty Target Upgrades

Bert provides a boiler plate framework that’ll allow one to write concurrent ETL code using Pythons’ microprocessing module. One function starts the process, piping data into a Redis backend that’ll then be consumed by the next function. The queues are respectfully named for the scope of the function: Work(start) and Done(end) queue. Please consider contributing to Bert Bounty Targets to improve this documentation

https://www.patreon.com/jbcurtin

## More to come Documentation is being worked on

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bert-etl-0.1.1.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

bert_etl-0.1.1-py2.py3-none-any.whl (10.0 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file bert-etl-0.1.1.tar.gz.

File metadata

  • Download URL: bert-etl-0.1.1.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.6.7

File hashes

Hashes for bert-etl-0.1.1.tar.gz
Algorithm Hash digest
SHA256 d6d52bb94932367144af340040a3ce87a14754db7e7e11fcedd9557dc21b1ad7
MD5 26e4406f72731c5f9073fc85d38fe7b0
BLAKE2b-256 50507e90461b6d17e39690a3d5dac32215302aabf1c3d0f5c13d3a4eee4797a6

See more details on using hashes here.

File details

Details for the file bert_etl-0.1.1-py2.py3-none-any.whl.

File metadata

  • Download URL: bert_etl-0.1.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 10.0 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.6.7

File hashes

Hashes for bert_etl-0.1.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 e2f6d245385ed788be99e499be9f09f2d8ab31fbce5f2fa9a1e0b9326f948e68
MD5 cbe80ed499666e5721b42f13e5cfe9c9
BLAKE2b-256 b6f7b976d11d75055fc331e1fec9a7e01f6a9b2c150864ddcb57a93fd00f1997

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page