- Date:
- 2018-10-01
- Version:
- 1.2.5
- License:
MIT License
Provides higher level interfaces to work with data producers and consumers. plumb supports five backends: RabbitMQ, Redis, Amazon SQS and SNS services, Kafka, and a memory implementation (designed to be a testing artifact).
The focus is on python 3 and boto3 (for AWS support).
The API
plumb uses the concepts of Source and Sink to abstract the backend. Data is transfered encoded in JSON, and by default compressed using zlib.
To fetch raw packages use a “Package Source” object, which handles a backend connection and its configuration and exposes a “get()” method. Similarly, a “Package Sink” object exposes a “put(pkg)” method.
You can either create the Sources and Sinks directly by instantiating them from their packages or use the convenience factory functions exposed in the plumb package. This functions receive a JSON with the configuration for the Sources or Sinks and returns a list of such configured devices.
Tests
The library is provided with unit tests and integration tests for Redis and AWS. To run the unit tests:
python setup.py test
or using nose:
nosetests tests/unit
The integration tests can be run using nose:
nosetests tests/integration
Keep in mind that boto3 will fetch your AWS credentials. It currently tries the environment variables AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY, then tries the ~/.aws directory. For details, see Boto3 Credentials Configuration.
2 maintainers
Release files for plumb 1.2.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| plumb-1.2.5.tar.gz | 9.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| plumb-1.2.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 23.2 kB
Release files / plumb-1.2.5.tar.gz
| Download URL | plumb-1.2.5.tar.gz |
|---|---|
| Size | 9.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
05ec1666dae8dffb78bdfe469a3cb5df12b4209e445e3cee193c0f24ec0bce5e
|
|
BLAKE2b-256 checksum How to use checksums |
0987d58078605149701ca4f09afe904d19059409b186261930e9d090b4c6a90e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6
|
Release files / plumb-1.2.5-py3-none-any.whl
| Download URL | plumb-1.2.5-py3-none-any.whl |
|---|---|
| Size | 13.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2a5973045c35977938ca859f2460047e4d7f3d014bfe16c6398477312da5e582
|
|
BLAKE2b-256 checksum How to use checksums |
1ce7e90cc38fa34e97b36529b322248307600810f6ad29009b7599210867f811
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.2.0 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6
|
