Skip to main content

Manage Kafka topics, schemas and permissions

Project description

Kafkalo is a tool to manage Kafka and Confluent Platform.

STATUS: while it does work, it is very rough around the edges. Consider this unstable and unreleased software for now.

It manages:

  • Topic creation and changes of settings

  • Schema creation and versioning.

  • Confluent RBAC rolebindings with predefined roles.

It also has a dry-run function that generates a plan. Whenever possible it will contact the services (for example Kafka broker with validate_only=True) and provide feedback on errors that will happen.

You provide a list of YAML input files (for example in a directory, with a glob pattern) and then Kafkalo will try to apply whatever is defined.

Usage

You can provide a config.yaml file so that kafkalo will know how to connect and possibly authenticate with your Kafka infrastrucure and related components (Schema registry, RBAC metadata server).

Look at sample config file included.

You can add input dirs with glob patterns to let kafkalo know where to find your YAML definitions. Kafkalo will read all the input YAMLs, merge then into a single internal data structure and try to sync them.

To generate a plan

> kafkalo plan

Once you are satisfied with the plan you can let kafkalo sync:

> kafkalo sync

Issues

History

0.1.0 (2021-02-23)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kafkalo-0.1.0.tar.gz (42.8 kB view hashes)

Uploaded Source

Built Distribution

kafkalo-0.1.0-py2.py3-none-any.whl (16.7 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page