Skip to main content

Python client for managing Kafka connectors..

Project description

kafka-connect-manager

GitHub Actions Docker Hub repository

A Python client to configure and create connectors using the Kafka Connect API.

Overview

Kafka-connect-manager helps to configure and create Kafka connectors. It can select Kafka topics using a regular expression and exclude topics added to a exclusion list. The auto-update option dynamically updates the connector if topics are created or deleted in Kafka.

Kafka-connect-manager can validate the connector configuration and return the validation output in case of errors.

Kafka-connect-manager provides a command line interface (CLI) to interact with the Kafka Connect API. Using the CLI you can manage existing connectors or create a new one.

To deploy a supported connector, you can use the kafka-connect-manager Helm chart.

Supported connectors

See the docs for more information.

Change log

0.8.0 (2020-08-05)

  • Use data classes for the application and connector configuration.

  • Plugin like organization, to support new connectors add a cli and a config file.

  • Add support to the Amazon S3 Sink connector

0.7.2 (2020-03-31)

  • Add support to the InfluxDB Sink Connector.

  • Add –timestamp option to select the timestamp field to use in the InfluxDB Sink connector.

  • Fix Header Converter Class configuration setting.

  • Fix tasks.max configuration setting name.

  • Add connector name configuration setting to support multiple connectors of the same class.

  • Handle empty list of topics properly.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kafkaconnect-0.8.0.tar.gz (51.9 kB view hashes)

Uploaded Source

Built Distribution

kafkaconnect-0.8.0-py3-none-any.whl (16.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page