mcp-server-xfetch 0.0.1

Enhanced MCP fetch server (fetch on steroids) that works through xfet.ch service. Unlocks access to websites blocked by Cloudflare and other protection systems that regular fetch can't handle.

XFetch MCP Server

Enhanced Model Context Protocol server for web content fetching (fetch on steroids). This server enables LLMs to retrieve and process content from any web pages, including those protected by Cloudflare and other security systems that regular fetch can't handle.

Key Features

• 🚀 Bypass Protection Systems: Access content from websites protected by Cloudflare and other security systems
• 🌐 JavaScript Rendering: Fetch content from dynamic websites that require JavaScript execution
• 🎯 CSS Selectors: Extract specific content from web pages using CSS selectors
• ⏱️ Dynamic Content Loading: Wait for dynamic content to load before fetching
• 📝 Markdown Conversion: Automatically converts HTML to markdown for easier LLM consumption
• 🔄 Chunked Reading: Read long pages in chunks using start_index parameter

Available Tools

• xfetch - Enhanced web content fetching tool with advanced capabilities
  • url (string, required): URL to fetch
  • max_length (integer, optional): Maximum number of characters to return (default: 5000)
  • start_index (integer, optional): Start content from this character index (default: 0)
  • raw (boolean, optional): Get raw content without markdown conversion (default: false)
  • render (boolean, optional): Enable JavaScript rendering for dynamic content (default: false)
  • selector (string, optional): CSS selector to extract specific content
  • timeout (integer, optional): Wait time in seconds for dynamic content loading (1-10 seconds)

Prompts

• xfetch
  • Fetch a URL and extract its contents as markdown
  • Arguments:
    • url (string, required): URL to fetch
    • render (boolean, optional): Enable JavaScript rendering
    • selector (string, optional): CSS selector for content extraction
    • timeout (integer, optional): Dynamic content loading timeout

Installation

Using pip

pip install mcp-server-xfetch

Using uv (recommended)

When using uv, no specific installation is needed:

uvx mcp-server-xfetch

Configuration

Configure for Claude.app

Add to your Claude settings:

Using uvx (recommended)

"mcpServers": {
  "xfetch": {
    "command": "uvx",
    "args": ["mcp-server-xfetch"]
  }
}

Using docker

"mcpServers": {
  "xfetch": {
    "command": "docker",
    "args": ["run", "-i", "--rm", "mcp/xfetch"]
  }
}

Using pip installation

"mcpServers": {
  "xfetch": {
    "command": "python",
    "args": ["-m", "mcp_server_xfetch"]
  }
}

API Token

To use the XFetch service, you need an API token. The default token included in the package has rate limits. For production use:

1. Visit xfet.ch to register
2. Get your API token from the dashboard
3. Set the token in your environment:

   export XFETCH_API_TOKEN=your_token_here
   

   Or pass it directly in the configuration:

   "args": ["mcp-server-xfetch", "--api-token=your_token_here"]
   

Examples

Basic Usage

# Simple fetch with markdown conversion
{
    "url": "https://example.com"
}

JavaScript Rendering

# Fetch from a dynamic website
{
    "url": "https://dynamic-site.com",
    "render": true,
    "timeout": 5  # Wait up to 5 seconds for content to load
}

Content Extraction

# Extract specific content using CSS selector
{
    "url": "https://news-site.com",
    "selector": "article.main-content",
    "render": true
}

Reading Long Content

# First request
{
    "url": "https://long-article.com",
    "max_length": 5000
}

# Continue reading from where it left off
{
    "url": "https://long-article.com",
    "start_index": 5000,
    "max_length": 5000
}

Debugging

You can use the MCP inspector to debug the server:

npx @modelcontextprotocol/inspector uvx mcp-server-xfetch

Contributing

We welcome contributions! Whether you want to add new features, fix bugs, or improve documentation, your help is appreciated.

1. Fork the repository
2. Create your feature branch
3. Commit your changes
4. Push to the branch
5. Create a Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Support

• Documentation: xfet.ch/docs
• Issues: GitHub Issues
• Email: [e-mail]