Skip to main content

grep kafka message reversely from the end offset to start offset

Project description

Kafka Logger

Build Status License: MIT

pip library that is used to read inversely the kafka message. The best part is each partition of topic will be run in parallel.

Background

A need to grep the message from kafka reversely because often we want to grep something from the most recent offset.

Problem

All the available debugging tools of kafka never introduced a feature to easily grep the message from the latest offset to the beginning of the offset. Thus, I created this open source project.

usage

pip install rervese-kafka-logger

reverse-kafka-logger --topic='topic' --brokers='localhost:9092,localhost:9093' --regex='search this'

Install

setup package: python setup.py dist

install package: pip install --no-index ./dist/{NEW_PACKAGE_NAME}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

reverse-kafka-logger-0.1.2.tar.gz (4.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page