Skip to main content

grep kafka message reversely from the end offset to start offset

Project description

Kafka Logger

Build Status License: MIT

pip library that is used to read inversely the kafka message. The best part is each partition of topic will be run in parallel.

Background

A need to grep the message from kafka reversely because often we want to grep something from the most recent offset.

Problem

All the available debugging tools of kafka never introduced a feature to easily grep the message from the latest offset to the beginning of the offset. Thus, I created this open source project.

usage

pip install rervese-kafka-logger

reverse-kafka-logger --topic='topic' --brokers='localhost:9092,localhost:9093' --regex='search this'

Install

setup package: python setup.py dist

install package: pip install --no-index ./dist/{NEW_PACKAGE_NAME}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

reverse-kafka-logger-0.1.2.tar.gz (4.7 kB view details)

Uploaded Source

File details

Details for the file reverse-kafka-logger-0.1.2.tar.gz.

File metadata

  • Download URL: reverse-kafka-logger-0.1.2.tar.gz
  • Upload date:
  • Size: 4.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/2.7.15

File hashes

Hashes for reverse-kafka-logger-0.1.2.tar.gz
Algorithm Hash digest
SHA256 515bf395adb748bd199a814dfff318a153878a8cd4306d5f82d667722a701a06
MD5 be962d65c9a4d459a8c1019fae23b3b4
BLAKE2b-256 eae227acaba952bf9efda16766dba1acb97686e8ecc96f2436eb575130d4e62d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page