Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

grep kafka message reversely from the end offset to start offset

Project description

Kafka Logger

Build Status License: MIT

pip library that is used to read inversely the kafka message. The best part is each partition of topic will be run in parallel.

Background

A need to grep the message from kafka reversely because often we want to grep something from the most recent offset.

Problem

All the available debugging tools of kafka never introduced a feature to easily grep the message from the latest offset to the beginning of the offset. Thus, I created this open source project.

usage

pip install rervese-kafka-logger

reverse-kafka-logger --topic='topic' --brokers='localhost:9092,localhost:9093' --regex='search this'

Install

setup package: python setup.py dist

install package: pip install --no-index ./dist/{NEW_PACKAGE_NAME}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for reverse-kafka-logger, version 0.1.2
Filename, size File type Python version Upload date Hashes
Filename, size reverse-kafka-logger-0.1.2.tar.gz (4.7 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page