Skip to main content

Python interface for splitting and/or merging Kafka topics

Project description

Kemux - Kafka Demultiplexer

Documentation Status Code linting Integration tests License: MIT Python 3.11

Kemux is a Kafka demultiplexer that allows to route messages from one topic to another based on a set of rules.

How it works

Kemux is a Python library that uses Robinhood's Faust to process messages from one topic and route them to another topic based on a set of rules.

The rules are defined within a Stream object, that defines input and output topics, schema of their messages, as well as a set of filters and transformations that are applied to messages.

Installation

Kemux can be installed via pip:

pip install kemux

Usage

Running as a standalone application

Kemux can be run as a standalone application, using the Manager class:

from kemux.manager import Manager

kemux_manager = Manager(
  ...
)
kemux_manager.start()

Running as a Docker container

Kemux can be deployed as a standalone Docker container. The process is described in the Docker section of the documentation.

Further reading

For more information about Kemux, please refer to the documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kemux-1.0.2b1.tar.gz (13.8 kB view hashes)

Uploaded Source

Built Distribution

kemux-1.0.2b1-py3-none-any.whl (15.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page