Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (
Help us improve Python packaging - Donate today!

Connect systems via Kafka, Redis, AWS SQS and SNS

Project Description

Provides higher level interfaces to work with data producers and consumers. plumb supports four backends: Redis, Amazon SQS and SNS services, Kafka, and a memory implementation (designed to be a testing artifact).

The focus is on python 3 and boto3 (for AWS support).


plumb uses the concepts of Source and Sink to abstract the backend. Data is transfered encoded in JSON, and by default compressed using zlib.

To fetch raw packages use a “Package Source” object, which handles a backend connection and its configuration and exposes a “get()” method. Similarly, a “Package Sink” object exposes a “put(pkg)” method.


The library is provided with unit tests and integration tests for Redis and AWS. To run the unit tests:

python test

or using nose:

nosetests tests/unit

The integration tests can be run using nose:

nosetests tests/integration

Keep in mind that boto3 will fetch your AWS credentials. It currently tries the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY, then tries the ~/.aws directory. For details, see Boto3 Credentials Configuration.

Release History

This version
History Node


History Node


History Node


History Node


History Node


History Node


History Node


History Node


History Node


History Node


History Node


Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, Size & Hash SHA256 Hash Help File Type Python Version Upload Date
(11.6 kB) Copy SHA256 Hash SHA256
Wheel py3 Feb 8, 2018
(7.2 kB) Copy SHA256 Hash SHA256
Source None Feb 8, 2018

Supported By

Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Google Google Cloud Servers DreamHost DreamHost Log Hosting