rag-mcp 0.1.3

This is a local rag-mcp solution with chromadb using langchain and docling

RAG MCP: Document Processing Server

A Retrieval-Augmented Generation (RAG) server built on the Model Context Protocol (MCP) for intelligent document processing and question answering.

Overview

RAG MCP is a tool that allows you to index various document formats and perform semantic searches against them. It uses advanced embedding techniques and vector databases to make your documents searchable through natural language queries.

Features

• Document Indexing: Support for various document formats (PDF, DOCX, XLSX, PPTX, Markdown, AsciiDoc, HTML, XHTML, CSV)
• Semantic Search: Query your documents using natural language
• High Performance: Optimized for various hardware configurations with automatic device selection (CUDA, MPS, CPU)
• Persistent Storage: Vector embeddings are stored locally for future use

Requirements

• Python 3.11+
• Environment with access to your documents

Installation

1. Install UV

First, you need to install UV, a Python package installer and resolver:

On macOS/Linux:

curl -sSf https://astral.sh/uv/install.sh | sh

On Windows:

powershell -c "irm https://astral.sh/uv/install.ps1 | iex"

2. Run RAG MCP

Once UV is installed, you can run RAG MCP directly using:

uvx rag-mcp

This will start the MCP server and make it available for document processing.

IDE Integration

VS Code Integration

To integrate with Visual Studio Code, create a mcp.json file with the following content:

{
    "servers": {
        "rag-mcp-server": {
            "type": "stdio",
            "command": "uvx",
            "args": [
                "rag-mcp"
            ],
            "env": {
                "PERSIST_DIRECTORY": "/path/to/your/persist/directory"
            }
        }
    }
}

Replace /path/to/your/persist/directory with the directory where you want to store your vector database.

Cursor Integration

To integrate with Cursor, go to Cursor Settings > MCP and paste this configuration:

{
    "mcpServers": {
      "rag-mcp": {
        "command": "uvx",
        "args": ["rag-mcp"],
        "env": {
          "PERSIST_DIRECTORY": "/path/to/your/persist/directory"
        }
      }
    }
  }

Usage

Supported Embedding Models

The system supports the following embedding model.

1. HuggingFace BGE Embeddings (default): High-quality embeddings that work offline
   • Uses BAAI/bge-m3 model

How It Works

1. Document Loading: Uses DoclingLoader to parse various document formats
2. Text Splitting: Documents are split into manageable chunks using RecursiveCharacterTextSplitter
3. Embedding Generation: Text chunks are converted to vector embeddings
4. Storage: Embeddings are stored in a Chroma vector database
5. Retrieval: When queried, the system finds semantically similar content to answer questions

Acknowledgments

• This project uses LangChain and Docling for intelligent document parsing
• Vector storage provided by Chroma
• Embedding models from HuggingFace
• Built on the Model Context Protocol (MCP)