kpops 3.0.1

KPOps is a tool to deploy Kafka pipelines to Kubernetes

KPOps

Key features

• Deploy Kafka apps to Kubernetes: KPOps allows to deploy consecutive Kafka Streams applications and producers using an easy-to-read and -write pipeline definition.
• Manage Kafka Connectors: KPOps connects with your Kafka Connect cluster and deploys, validates, and deletes your connectors.
• Configure multiple pipelines and steps: KPOps has various abstractions that simplify configuring multiple pipelines and steps within pipelines by sharing common configuration between different components, such as producers or streaming applications.
• Handle your topics and schemas: KPOps not only creates and deletes your topics but also registers and deletes your schemas.
• Clean termination of Kafka components: KPOps removes your pipeline components (i.e., Kafka Streams applications) from the Kubernetes cluster and cleans up the component-related states (i.e., removing/resetting offset of Kafka consumer groups).
• Preview your pipeline changes: With the KPOps dry-run, you can ensure your pipeline definition is set up correctly. This helps to minimize downtime and prevent potential errors or issues that could impact your production environment.

Documentation

For detailed usage and installation instructions, check out the documentation.

Install KPOps

KPOps comes as a PyPI package. You can install it with pip:

pip install kpops

GitHub action

Please refer to the GitHub Actions section for the documentation.

Contributing

We are happy if you want to contribute to this project. If you find any bugs or have suggestions for improvements, please open an issue. We are also happy to accept your PRs. Just open an issue beforehand and let us know what you want to do and why.

License

KPOps is licensed under the MIT License.