Kinesis utilities
Miscellaneous utilities for AWS Kinesis.
Installation
pip install kinesisutils
To install the development version:
pip install git+https://github.com/findhotel/kinesisutils
Usage
At the moment there is only one utility implemented: a Python generator that reads records from a Kinesis stream. You can use it like this:
import json
from kinesisutils.kinesisutils import KinesisGenerator
# Hit Kinesis with at most 10 requests per second, usin json.loads to
# deserialize the Kinesis records (the default). You could deactivate record
# deserialization by setting des=None.
kg = KinesisGenerator("stream_name", rqs=10, des=json.loads)
for rec in kg:
print(rec)
By default the generator will keep pulling records from Kinesis for 60 seconds. You can customize this timeout if you want:
from kinesisutils.kinesisutils import KinesisGenerator
kg = KinesisGenerator("stream_name", timeout=30)
for rec in kg:
print(rec)
If you are using the Kinesis generator to read Cloudwatch log events that are being forwarded to a Kinesis stream using a [logs subscription][logsubs] you will need to decompress the Cloudwatch records before deserializing them:
import decompress
import json
kg = KinesisGenerator("stream_name", rqs=10, des=json.loads,
preprocess=gzip.decompress)
for rec in kg:
print(rec)
Contact
If you have questions, bug reports, suggestions, etc. please create an issue on the GitHub project page. PRs are also welcome.
License
This software is licensed under the MIT license.
See License file.
© 2017 German Gomez-Herrero, Find Hotel and others.
Metadata
Release files for kinesisutils 0.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| kinesisutils-0.0.6.tar.gz | 3.5 kB | Without provenance | Details for kinesisutils-0.0.6.tar.gz |
Release files / kinesisutils-0.0.6.tar.gz
| Download URL | kinesisutils-0.0.6.tar.gz |
|---|---|
| Size | 3.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9b986ff10ba9393a538105351e2aff6632300055f74ae489f45ab06886fd105f
|
|
BLAKE2b-256 checksum How to use checksums |
1913037cd178d63a09199111e4370a84b03e70a0ee0cfdb3ba152fae01928658
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
Security for kinesisutils 0.0.6
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.