Kafka MCP Server
A Message Context Protocol (MCP) server that integrates with Apache Kafka to provide publish and consume functionalities for LLM and Agentic applications.
Overview
This project implements a server that allows AI models to interact with Kafka topics through a standardized interface. It supports:
- Publishing messages to Kafka topics
- Consuming messages from Kafka topics
Prerequisites
- Python 3.8+
- Apache Kafka instance
- Python dependencies (see Installation section)
Installation
-
Clone the repository:
git clone <repository-url> cd <repository-directory>
-
Create a virtual environment and activate it:
python -m venv venv source venv/bin/activate # On Windows, use: venv\Scripts\activate
-
Install the required dependencies:
pip install -r requirements.txt
If no requirements.txt exists, install the following packages:
pip install aiokafka python-dotenv pydantic-settings mcp-server
Configuration
Create a .env file in the project root with the following variables:
# Kafka Configuration
KAFKA_BOOTSTRAP_SERVERS=localhost:9092
TOPIC_NAME=your-topic-name
IS_TOPIC_READ_FROM_BEGINNING=False
DEFAULT_GROUP_ID_FOR_CONSUMER=kafka-mcp-group
# Optional: Custom Tool Descriptions
# TOOL_PUBLISH_DESCRIPTION="Custom description for the publish tool"
# TOOL_CONSUME_DESCRIPTION="Custom description for the consume tool"
Usage
Running the Server
You can run the server using the provided main.py script:
python main.py --transport stdio
Available transport options:
stdio: Standard input/output (default)sse: Server-Sent Events
Integrating with Claude Desktop
To use this Kafka MCP server with Claude Desktop, add the following configuration to your Claude Desktop configuration file:
{
"mcpServers": {
"kafka": {
"command": "python",
"args": [
"<PATH TO PROJECTS>/main.py"
]
}
}
}
Replace <PATH TO PROJECTS> with the absolute path to your project directory.
Project Structure
main.py: Entry point for the applicationkafka.py: Kafka connector implementationserver.py: MCP server implementation with tools for Kafka interactionsettings.py: Configuration management using Pydantic
Available Tools
kafka-publish
Publishes information to the configured Kafka topic.
kafka-consume
consume information from the configured Kafka topic.
- Note: once a message is read from the topic it can not be read again using the same groupid
Create-Topic
Creates a new Kafka topic with specified parameters.
- Options:
--topicName of the topic to create--partitionsNumber of partitions to allocate--replication-factorReplication factor across brokers--config(optional) Topic-level configuration overrides (e.g.,retention.ms=604800000)
Delete-Topic
Deletes an existing Kafka topic.
- Options:
--topicName of the topic to delete--timeout(optional) Time to wait for deletion to complete
List-Topics
Lists all topics in the cluster (or filtered by pattern).
- Options:
--bootstrap-serverBroker address--pattern(optional) Regular expression to filter topic names--exclude-internal(optional) Exclude internal topics (default: true)
Topic-Configuration
Displays or alters configuration for one or more topics.
- Options:
--describeShow current configs for a topic--alterModify configs (e.g.,--add-config retention.ms=86400000,--delete-config cleanup.policy)--topicName of the topic
Topic-Metadata
Retrieves metadata about a topic or the cluster.
- Options:
--topic(If provided) Fetch metadata only for this topic--bootstrap-serverBroker address--include-offline(optional) Include brokers or partitions that are offline
Metadata
Release files for iflow-mcp_kafka_mcp_server 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| iflow_mcp_kafka_mcp_server-0.1.0.tar.gz | 13.0 kB | Without provenance | Details for iflow_mcp_kafka_mcp_server-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| iflow_mcp_kafka_mcp_server-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for iflow_mcp_kafka_mcp_server-0.1.0-py3-none-any.whl |
Total release size: 26.8 kB
Release files / iflow_mcp_kafka_mcp_server-0.1.0.tar.gz
| Download URL | iflow_mcp_kafka_mcp_server-0.1.0.tar.gz |
|---|---|
| Size | 13.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
90b86923828a8a9e82bf339e1c1ef65e2edb075f312ba253191b761b732dae29
|
|
BLAKE2b-256 checksum How to use checksums |
06e36bffac22a369b350e5fbc888c6718d1f8f32fe3966abef120fd90fd9240b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.6.9
|
Release files / iflow_mcp_kafka_mcp_server-0.1.0-py3-none-any.whl
| Download URL | iflow_mcp_kafka_mcp_server-0.1.0-py3-none-any.whl |
|---|---|
| Size | 13.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2bcb653656967b643c7e0bd11aa953264170c4e9eff190384e1f7e92809a452e
|
|
BLAKE2b-256 checksum How to use checksums |
122eb2af25a409a1bc7e6b558a5b37bdfcfa01459ad42837ddec3d1076371194
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.6.9
|
Security for iflow-mcp_kafka_mcp_server 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.