Skip to main content

Connect systems via various queuing backends

Project description

Author: Elvio Toccalino
Date: 2019/05/20
Version: 0.7.0

Provides higher level interfaces to work with data producers and consumers. plumb supports three backends: Redis, Amazon SQS and SNS services, and a memory implmentation (designed to be a testing artifact).

The focus is on python 3 and boto3 (for AWS support).

The API

plumb uses the concepts of Source and Sink to abstract the backend. Data is transfered encoded in JSON.

To fetch raw packages use a “Package Source” object, which handles a backend connection and its configuration and exposes a “get()” method. Similarly, a “Package Sink” object exposes a “put(pkg)” method.

Tests

The library is provided with unit tests and integration tests for Redis and AWS. To run the unit tests:

python setup.py test

or using nose:

nosetests tests/unit

The integration tests can be run using nose:

nosetests tests/integration

Keep in mind that boto3 will fetch your AWS credentials. It currently tries the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY, then tries the ~/.aws directory. For details, see Boto3 Credentials Configuration.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for plumb, version 0.7.0
Filename, size File type Python version Upload date Hashes
Filename, size plumb-0.7.0.linux-x86_64.tar.gz (9.0 kB) File type Dumb Binary Python version any Upload date Hashes View hashes
Filename, size plumb-0.7.0-py3-none-any.whl (9.2 kB) File type Wheel Python version 3.5 Upload date Hashes View hashes
Filename, size plumb-0.7.0.tar.gz (5.4 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page