Skip to main content

Manage Kafka topics, schemas and permissions

Project description

Kafkalo is a tool to manage Kafka and Confluent Platform.

STATUS: while it does work, it is very rough around the edges. Consider this unstable and unreleased software for now.

It manages:

  • Topic creation and changes of settings

  • Schema creation and versioning.

  • Confluent RBAC rolebindings with predefined roles.

It also has a dry-run function that generates a plan. Whenever possible it will contact the services (for example Kafka broker with validate_only=True) and provide feedback on errors that will happen.

You provide a list of YAML input files (for example in a directory, with a glob pattern) and then Kafkalo will try to apply whatever is defined.

Usage

You can provide a config.yaml file so that kafkalo will know how to connect and possibly authenticate with your Kafka infrastrucure and related components (Schema registry, RBAC metadata server).

Look at sample config file included.

You can add input dirs with glob patterns to let kafkalo know where to find your YAML definitions. Kafkalo will read all the input YAMLs, merge then into a single internal data structure and try to sync them.

To generate a plan

> kafkalo plan

Once you are satisfied with the plan you can let kafkalo sync:

> kafkalo sync

Issues

History

0.1.0 (2021-02-23)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kafkalo-0.1.0.tar.gz (42.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kafkalo-0.1.0-py2.py3-none-any.whl (16.7 kB view details)

Uploaded Python 2Python 3

File details

Details for the file kafkalo-0.1.0.tar.gz.

File metadata

  • Download URL: kafkalo-0.1.0.tar.gz
  • Upload date:
  • Size: 42.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.1

File hashes

Hashes for kafkalo-0.1.0.tar.gz
Algorithm Hash digest
SHA256 c712a8ceb649b34c76b87d5bc8221747b7fb05c835bef07305ebd41e42257209
MD5 4065ba25004f4b0633da951212941676
BLAKE2b-256 d8a2bb0a54f2e87e19f38861c778267dd130b0ee76857200be07829c4cd3a30f

See more details on using hashes here.

File details

Details for the file kafkalo-0.1.0-py2.py3-none-any.whl.

File metadata

  • Download URL: kafkalo-0.1.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 16.7 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.1 importlib_metadata/3.7.3 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.8.1

File hashes

Hashes for kafkalo-0.1.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 f0095dd112d31ec04759c77818f9974182d3658307c18b90fa8652657450d08d
MD5 d7d85f066ebdb374d1140917ecc0202e
BLAKE2b-256 de0c8834bc6d7640e925e382cf2fdacdb6e97394be54b972e073887ba7909a3e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page