Skip to main content
Archived

This project has been archived by its maintainers, and is no longer receiving any updates.

kinsumer
========

High level [Amazon Kinesis Streams](https://aws.amazon.com/kinesis/streams/) consumer.

Some features
-------------

* Automatically detect shard count changes
* Checkpoints/sequences persistence can be customized
* Provided Checkpointer implementation for memory, and file
* Memory bucket for temporary saving records

Usage
-----

```python
from kinsumer import Consumer

STREAM_REGION = 'ap-south-1'
STREAM_NAME = 'my-stream'
consumer = Consumer(__name__)
consumer.config.from_object(__name__)

@consumer.transform
def transform(data, shard_id, last_sequence_number, last_arrival_timestamp):
"""do transform and return"""
return data

@consumer.after_consume
def after(data, shard_id, last_sequence_number, last_arrival_timestamp):
"""after transform and do something"""

if __name__ == '__main__':
consumer.process()
```

Author and license
------------------

kinsumer is written by [Ungi Kim](https://ungikim.me/), maintained by [Balance Hero](http://truebalance.io/), and licensed under the MIT license. You can find the source code from [Github](https://github.com/balancehero/kinsumer):

```
$ git clone git@github.com:balancehero/kinsumer.git
```

Missing features
----------------

* Redis Checkpointer
* Consumer Heartbeat

(Contributions would be appreciated!)

Metadata

Release files for kinsumer 0.5.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for kinsumer 0.5.3
File Size Uploaded Provenance Actions
kinsumer-0.5.3.tar.gz 13.1 kB Without provenance Details for kinsumer-0.5.3.tar.gz

Release files / kinsumer-0.5.3.tar.gz

Download URL kinsumer-0.5.3.tar.gz
Size 13.1 kB
Tags Source
SHA-256 checksum
How to use checksums
a330bb47da69a769d58eb2aab2def90a7f7657dd5bd9840363fc6ed25c304d7f
BLAKE2b-256 checksum
How to use checksums
40dcc67dab02aa0270742c8a8665ce82aa6bd55cf1ec981e5aef3f3dcf5e954e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for kinsumer 0.5.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page