channels-kafka 0.1.1

Kafka Channels backend

Channels 🔗 Kafka

channels-kafka

A Django Channels channel layer that uses Kafka as its backing store.
Explore the docs »

Report Bug · Request Feature

Table of Contents

1. About The Project
   • Built With
2. Getting Started
   • Prerequisites
   • Installation
3. Usage
4. Contributing
5. Testing
6. License
7. Contact

About The Project

Provides channel layer for django channels using kafka

(back to top)

Built With

• 
• 

(back to top)

Getting Started

To work with django channels using this channel layer you will need to have working kafka cluster. As of time of writing, this library was only tested on Kafka with Kraft Mode.

Prerequisites

channels-kafka should be able to be installed using any package manager of your choice, although ci tests use uv

Installation

• uv

  uv add channels-kafka
  

• pip

  pip install channels-kafka
  

(back to top)

Usage

Assuming that you already have a working django-channels app using any other layer, the only thing you would need to do in your django code is to change CHANNEL_LAYERS setting in your django to use this backend with all releavant configuration.

CHANNEL_LAYERS = {
    "default": {
        "BACKEND": "channels_kafka.core.KafkaChannelLayer",
        "CONFIG": {
            "hosts": os.getenv("KAFKA_HOSTS", "localhost:9092").split(","),
            "client_id": os.getenv("KAFKA_CLIENT_ID", socket.gethostname()),
            "topic": os.getenv("KAFKA_CLIENT_ID", "channels-kafka"),
            "group_id": os.getenv("KAFKA_GROUP_ID", "channels-kafka-group"),
        },
    },
}

As for kafka broker, you would need to:

• create desired topic
• set offsets.topic.replication.factor to 1 since channels documentation says you should be ok with some messages not being delivered to increase throughput
• set max.in.flight.requests.per.connection to 1 to ensure that messages are delivered in order

Both settings can be scoped only to created topic aswell

(back to top)

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

Testing

Check all caps constants in https://github.com/PawelKawula/channels-kafka/blob/master/tests/test_core.py to see which env variables you need to provide to run tests using your kafka cluster and then run

  pytest

(back to top)

Top contributors:

License

Distributed under the MIT license. See LICENSE for more information.

(back to top)

Contact

Project Link: https://github.com/PawelKawula/channels-kafka

(back to top)