mcpdoc-daemon 0.2.0

A daemon that monitors configuration and llms.txt files and automatically reloads mcpdoc server when changes are detected

MCPDoc Daemon

A simple daemon that monitors configuration files and automatically reloads mcpdoc when changes are detected.

About MCPDoc

MCPDoc is a tool that serves documentation using the Model Context Protocol (MCP). It allows you to create documentation servers that can be consumed by LLM applications, providing structured access to documentation from various sources including local llms.txt files and direct URLs.

This daemon provides automated monitoring and reloading capabilities for the mcpdoc server, making it easy to provide up-to-date documentation to LLMs using a single MCP server configuration.

Features

• Monitors a mounted directory for config.yaml and *.llms.txt files
• Automatically restarts mcpdoc when configuration changes
• Supports dynamic URL discovery from .llms.txt files
• Uses file watching for immediate response to changes
• Container-ready with Podman/Docker support
• Uses watchdog library for file monitoring with debouncing
• Executes mcpdoc CLI as a subprocess for better isolation and compatibility

Architecture Overview

graph TB
    subgraph "MCPDoc Daemon Process"
        D[MCPDocDaemon]
        FH[MCPDocConfigHandler]
        O[Watchdog Observer]

        D --> |creates| FH
        D --> |creates| O
        FH --> |restart trigger| D
        O --> |file events| FH
    end

    subgraph "File System"
        CD[config Directory]
        CY[config.yaml]
        LT1[service1.llms.txt]
        LT2[service2.llms.txt]
        LTN[serviceN.llms.txt]

        CD --> CY
        CD --> LT1
        CD --> LT2
        CD --> LTN
    end

    subgraph "MCPDoc CLI Process"
        CLI[python -m mcpdoc.cli]
        SERVER[SSE Server :8080]

        CLI --> |spawns| SERVER
    end

    subgraph "Client Access"
        HTTP[HTTP Requests]
        SSE[Server-Sent Events]

        HTTP --> SERVER
        SERVER --> SSE
    end

    %% Process Flow
    O --> |monitors| CD
    CD --> |file changes| O
    D --> |subprocess.Popen| CLI
    D --> |terminate/kill| CLI

    %% Configuration Flow
    D --> |load_config| CY
    D --> |discover_llms_files| LT1
    D --> |discover_llms_files| LT2
    D --> |discover_llms_files| LTN
    D --> |build_mcpdoc_command| CLI

    %% Styling
    classDef daemon fill:#e1f5fe
    classDef fileSystem fill:#f3e5f5
    classDef mcpdoc fill:#e8f5e8
    classDef client fill:#fff3e0

    class D,FH,O daemon
    class CD,CY,LT1,LT2,LTN fileSystem
    class CLI,SERVER mcpdoc
    class HTTP,SSE client

Architecture Components

1. MCPDocDaemon: Main daemon class that orchestrates the entire process
2. MCPDocConfigHandler: File system event handler for configuration changes
3. Watchdog Observer: Monitors the config directory for file changes
4. MCPDoc CLI Process: Subprocess running the mcpdoc server
5. Configuration Files: YAML config and .llms.txt documentation files

Process Flow

1. Initialization: Daemon starts and creates file monitoring setup
2. Configuration Loading: Reads config.yaml and discovers .llms.txt files
3. Command Building: Constructs mcpdoc CLI command with appropriate flags
4. Subprocess Launch: Starts mcpdoc CLI as a subprocess with SSE transport
5. File Monitoring: Continuously watches for configuration file changes
6. Auto-Restart: Gracefully terminates and restarts subprocess on changes

Installation

Using pipx

pipx install mcpdoc-daemon

Quick Start

1. By default, the daemon will use a directory named mcpdoc in your platform's default config directory:

   • On Linux: ~/.config/mcpdoc/
   • On macOS: ~/Library/Application Support/mcpdoc/
   • On Windows: C:\Users\<username>\AppData\Local\mcpdoc\

   You can create this directory if it doesn't exist:

# For Linux
mkdir -p ~/.config/mcpdoc

2. Add your configuration files to this directory:

   • config.yaml - mcpdoc configuration
   • *.llms.txt - LLM text files (e.g., fastapi.llms.txt, something.llms.txt)

   Alternatively, you can specify a custom config directory using the --config-dir option.

3. Build and run the container:

Using Docker Compose / Podman Compose

podman compose up --build
# or
docker compose up --build

Local Development (Python)

poetry install
poetry run mcpdoc-daemon

Manual Container Usage

Build the container:

podman build -t mcpdoc-daemon .

Run the container:

podman run -d \
  --name mcpdoc-daemon \
  -p 8080:8080 \
  -v ./config:/config:z,ro \
  ghcr.io/abn/mcpdoc-daemon:latest --config-dir /config

Note: When using containers, you need to explicitly set the config directory to /config using the --config-dir option to use the mounted volume.

Configuration Structure

Your configuration directory should contain:

<config-dir>/
├── config.yaml          # Main mcpdoc configuration (YAML format)
├── config.json          # Alternative JSON configuration (if no YAML)
├── fastapi.llms.txt     # FastAPI documentation URLs
├── something.llms.txt   # Other service documentation URLs
└── ...                  # Additional .llms.txt files

Where <config-dir> is either:

• The platform's default config directory + /mcpdoc (default)
• A custom directory specified with --config-dir
• The /config directory when using containers with the appropriate volume mount

Note: If both config.yaml and config.json exist, the daemon will prioritize config.yaml and pass it to mcpdoc using the --yaml flag. If only config.json exists, it will be passed using the --json flag.

Generated Command

The daemon will automatically generate and execute a command similar to:

python -m mcpdoc.cli --yaml <config-dir>/config.yaml \
  --urls "fastapi:<config-dir>/fastapi.llms.txt" "something:<config-dir>/something.llms.txt" \
  --follow-redirects --timeout 10.0 \
  --allowed-domains '*' \
  --transport sse \
  --host 0.0.0.0 \
  --port 8080 \
  --log-level INFO

Where <config-dir> is the path to your configuration directory.

File Monitoring

The daemon monitors your configuration directory for:

• File modifications
• File creation/deletion
• File moves

The implementation uses the watchdog library with debouncing to prevent excessive restarts when multiple file changes occur in rapid succession.

When relevant files (config.yaml, config.json, or *.llms.txt) change, mcpdoc is automatically restarted with the updated configuration.

Containerization

The container uses multi-stage builds with Poetry for better caching and smaller final images:

Features:

• Multi-stage builds: Separate builder and runtime stages for optimal image size
• Layer caching: Poetry and pip caches are mounted for faster builds
• Configurable base image: Uses ARG BASE_IMAGE=docker.io/python:3.13-slim
• Runtime optimization: Minimal runtime image with only required dependencies
• Poetry integration: Uses Poetry for dependency management instead of pip

Build Stages:

• base: Sets up Poetry and basic environment
• builder: Installs dependencies and copies application files
• runtime-base: Builds the wheel package
• runtime (default): Production-ready minimal image

Implementation Details

The implementation (mcpdoc_daemon.py) offers several features:

• CLI Integration: Executes mcpdoc CLI as a subprocess for better isolation and compatibility
• SSE Transport: Uses Server-Sent Events transport for real-time communication
• Advanced Monitoring: Watchdog library provides robust cross-platform file monitoring
• Debouncing: Prevents excessive restarts during rapid file changes
• Configurability: Environment variables and command-line options
• Development Mode: Can run locally without containers
• Process Management: Graceful subprocess termination with fallback to force kill

Environment Variables

• MCPDOC_CONFIG_DIR: Configuration directory (default: <platform config dir>/mcpdoc)
• MCPDOC_HOST: Server host (default: 0.0.0.0)
• MCPDOC_PORT: Server port (default: 8080)
• MCPDOC_LOG_LEVEL: Logging level (default: INFO)
• MCPDOC_TRANSPORT: Transport method (default: sse)

Command Line Options

mcpdoc-daemon --help

Access

Once running, mcpdoc will be accessible at http://localhost:8080

Logs

View container logs:

podman logs -f mcpdoc-daemon

Stopping

Stop the daemon:

podman compose down

Or for manual container:

podman stop mcpdoc-daemon

Systemd User Service

You can run MCPDoc Daemon as a systemd user service. See systemd.md for more information.