Skip to main content

Kafka consumer to handle ESS flatbuffer messages and provide a rich display on console.

Project description

ESS command-line message consumer

  • Kafka commandline message consumer specific to handle ESS flatbuffer messages of types

    name description
    pl72 Run start
    6s4t Run stop
    f142 Log data
    ev42 Event data
    x5f2 Status messages
    answ File-writer command response
    wrdn File-writer finished writing
    ADAr EPICS area detector data

Installing

ess_message_consumer

Create virtual environment with Python 3.6 or later:

git clone https://github.com/ebadkamil/ess-message-consumer.git
cd ess-message-consumer
python3 -m venev {env_name}

Activate virtual environment and install ess-message-consumer:

source {env_name}/bin/activate
pip install .

Usage:

  • Start consuming ESS flatbuffer messages from given topics

      start_consumer -b {broker_address} -t {topics_to_consume_msg_from} --rich_console
      broker_address: for eg. "localhost:9092"
      topics_to_consume_msg_from: "topic_1, topic_2, ..."
      rich_console: optional for rich layout console.
    
  • List all available topics on a broker

      list_available_topics -b {broker_address}
    
  • Produce messages on a kafka-topic for debugging purposes:

      start_producer -b {broker_address}
      # This will prompt you to input following information in order:
          # 1. Topic Name: {topic_name_to_publish_data_to}
          # 2. Message to send: {put your message here}
          # 3. Exit ? (y/n)
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ess-message-consumer-0.1.3.tar.gz (8.3 kB view details)

Uploaded Source

File details

Details for the file ess-message-consumer-0.1.3.tar.gz.

File metadata

  • Download URL: ess-message-consumer-0.1.3.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.5

File hashes

Hashes for ess-message-consumer-0.1.3.tar.gz
Algorithm Hash digest
SHA256 2996c293b0e950b71552e1a0dee7e1516852ce056fbe9a515132a9c5c1256a62
MD5 b71b69dd0adfa303377e6dfbbf04f54f
BLAKE2b-256 5461439276f0a5fd7e6cae4adba688b58bae7518400cab0f414d153954aa0380

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page