hydrant 0.3.0

Redirects stdin to Amazon Kinesis Firehose.

Redirects stdin to Amazon Kinesis Firehose.

The application submits each record one at a time, which limits the throughput. A future version might batch records together for performance, but until then beware of using high throughput streams (15 records per second or more). Running from within EC2 will allow higher throughput.

Installation

Install into a virtualenv.

$ pip install --editable .

Usage

Pipe newline separated records into hydrant, which will send each record to the delivery stream:

$ producer | hydrant my-firehose-stream

Specify a region if not using us-east-1:

$ producer | hydrant --region='us-west-2' my-firehose-stream

Read the help text for more information:

$ hydrant --help