Redirects stdin to Amazon Kinesis Firehose.
Project description
Redirects stdin to Amazon Kinesis Firehose.
The application submits each record one at a time, which limits the throughput. A future version might batch records together for performance, but until then beware of using high throughput streams (15 records per second or more). Running from within EC2 will allow higher throughput.
Installation
Install into a virtualenv.
$ pip install --editable .
Usage
Pipe newline separated records into hydrant, which will send each record to the delivery stream:
$ producer | hydrant my-firehose-stream
Specify a region if not using us-east-1:
$ producer | hydrant --region='us-west-2' my-firehose-stream
Read the help text for more information:
$ hydrant --help
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file hydrant-0.3.0.tar.gz
.
File metadata
- Download URL: hydrant-0.3.0.tar.gz
- Upload date:
- Size: 2.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 252675fbaca67057cf3b0cc7c32f322f9d2489077443964a61cd321fa53eed64 |
|
MD5 | c373cf0cac89d1deb0c8d3d4427a2e0f |
|
BLAKE2b-256 | 4f54a7e4a88b99cfdf8422e2f3639ad328d35da3be43307a354455e56613b410 |
File details
Details for the file hydrant-0.3.0-py2.py3-none-any.whl
.
File metadata
- Download URL: hydrant-0.3.0-py2.py3-none-any.whl
- Upload date:
- Size: 4.6 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 74c2537246f857de286c2ef6e60d2b1d26b4bb72b47c4e8502fad95371885945 |
|
MD5 | 6a6d1e236bb905b2054effa83a3880a3 |
|
BLAKE2b-256 | 13fea1e01d65ea86766bad427903b0da29c84bbbba52ff114f442845ed2612b1 |