kafka-mcp 0.10.0

Apache Kafka (REST Proxy / native) API + MCP Server + A2A Server for Agentic AI!

Kafka Mcp

API | MCP Server | A2A Agent

Apache Kafka API + MCP Server + A2A Agent for the agent-utilities ecosystem.

Version: 0.5.0

Documentation — Installation, deployment, usage across the API, CLI, and MCP interfaces, and guidance for provisioning the Apache Kafka platform are maintained in the official documentation.

kafka-mcp wraps the Apache Kafka administration and data-plane surface with typed, deterministic tools an agent or policy router calls. It speaks to the Confluent REST Proxy by default and ships an optional native (direct-to-broker) client and a Pydantic-AI agent server.

What it provides

• KafkaApi (kafka_mcp.api.api_client_kafka) — a requests-based REST facade over the Confluent REST Proxy v3 (with v2 consumer helpers), organized by Kafka resource: clusters, topics, partitions, records, consumer groups, brokers, and ACLs. The active cluster id resolves lazily unless KAFKA_CLUSTER_ID pins it.
• Six MCP tools (kafka-mcp console script): kafka_topics, kafka_partitions, kafka_records, kafka_groups, kafka_cluster, and the optional native kafka_native. See docs/overview.md for the full action surface.
• An A2A agent server (kafka-agent console script) — a Pydantic-AI graph agent wired to the MCP server via MCP_URL.

Configuration (environment)

Var	Default	Meaning
KAFKA_REST_URL	http://localhost:8082	Confluent REST Proxy base URL
KAFKA_CLUSTER_ID	(auto)	Pin the cluster id (else the first cluster is cached)
KAFKA_TOKEN	(empty)	Bearer token for the REST Proxy
KAFKA_USERNAME	(empty)	Basic-auth user (optional)
KAFKA_PASSWORD	(empty)	Basic-auth password (optional)
KAFKA_SSL_VERIFY	True	Verify TLS (set False for self-signed homelab)
KAFKATOOL	True	Register the Kafka tool set

The optional native client reads KAFKA_BOOTSTRAP_SERVERS (default localhost:9092) and requires the kafka-mcp[native] extra. Copy .env.example to .env and populate only what you use; blank connector credentials leave the corresponding surface inactive.

Install & run

pip install -e .
kafka-mcp                        # stdio MCP server (default transport)
kafka-mcp --transport streamable-http --host 0.0.0.0 --port 8000

Run the agent server against a live MCP server:

kafka-agent --mcp-url http://localhost:8000/mcp --host 0.0.0.0 --port 8080

MCP config

Register in your client's mcp_config.json (tools surface as kafka_topics, kafka_records, kafka_groups, …). See kafka_mcp/mcp_config.json.

Additional Deployment Options

kafka-mcp can also run as a local container (Docker / Podman / uv) or be consumed from a remote deployment. The Deployment guide has full, copy-paste mcp_config.json for all four transports — stdio, streamable-http, local container / uv, and remote URL:

• Local container / uv — launch the server from mcp_config.json via uvx, docker run, or podman run, or point at a local streamable-http container by url.
• Remote URL — connect to a server deployed behind Caddy at http://kafka-mcp.arpa/mcp using the "url" key.

Documentation

The complete documentation is published as the official documentation site and is the recommended reference for installation, deployment, and day-to-day operation.

Page	Contents
Installation	pip, source, extras, prebuilt Docker image
Deployment	run the MCP and agent servers, Compose, Caddy + Technitium, env config
Usage	the MCP tools, the KafkaApi client, the CLI
Backing Platform	deploy Apache Kafka with Docker
Overview	tools, REST contract, native client
Architecture	the layered REST client and tool surface
Concepts	concept registry (CONCEPT:KAFKA-*)

AGENTS.md is the canonical contributor/agent guidance.