Skip to main content

Simple URL fetcher MCP server for Scrapling. Retrieves HTML/markdown from automation-blocking sites with three protection levels.

Project description

Scrapling Fetch MCP Server

A simple Model Context Protocol (MCP) server implementation that integrates with Scrapling for retrieving web content with advanced bot detection avoidance.

Intended Use

This tool is optimized for low volume retrieval of documentation and reference materials (text/html only) from websites that implement bot detection. It has not been designed or tested for general-purpose site scraping or data harvesting.

Features

  • Retrieve content from websites that implement advanced bot protection
  • Three protection levels (basic, stealth, max-stealth)
  • Two output formats (HTML, markdown)

Installation

Install scrapling

uv tool install scrapling
scrapling install
uv tool install scrapling-fetch-mcp

Usage with Claude

Add this configuration to your Claude client's MCP server configuration:

{
  "mcpServers": {
    "Cyber-Chitta": {
      "command": "uvx",
      "args": ["scrapling-fetch-mcp"]
    }
  }
}

Available Tools

scrapling-fetch

Fetch a URL with configurable bot-detection avoidance levels.

{
  "name": "scrapling-fetch",
  "arguments": {
    "url": "https://example.com",
    "mode": "stealth",
    "format": "markdown",
    "max_length": 5000,
    "start_index": 0
  }
}

Parameters

  • url (required): The URL to fetch
  • mode (optional, default: "basic"): Protection level
    • basic: Fast retrieval with minimal protection
    • stealth: Balanced protection against bot detection
    • max-stealth: Maximum protection with all anti-detection features
  • format (optional, default: "markdown"): Output format (options: html, markdown)
  • max_length (optional, default: 5000): Maximum number of characters to return
  • start_index (optional, default: 0): Character index to start from in the response (useful for paginated content)

License

Apache 2

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapling_fetch_mcp-0.1.1.tar.gz (116.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scrapling_fetch_mcp-0.1.1-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file scrapling_fetch_mcp-0.1.1.tar.gz.

File metadata

  • Download URL: scrapling_fetch_mcp-0.1.1.tar.gz
  • Upload date:
  • Size: 116.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.29

File hashes

Hashes for scrapling_fetch_mcp-0.1.1.tar.gz
Algorithm Hash digest
SHA256 20d0c17d3d4b84e3fd341001e1610768339cfd0d3368557f512741e641e0c783
MD5 0251c3458928d247b647cf5a7dcd11a2
BLAKE2b-256 eeb5b8a0b2dfec054ce93d3adc8028b27427e2d4cba06d923b43511858a6c9eb

See more details on using hashes here.

File details

Details for the file scrapling_fetch_mcp-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for scrapling_fetch_mcp-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 a8ea4efee96b41d08fe90e47a547e1a5904324a242ec20061ec90595987219ad
MD5 35845ceb88172517d057b4c3b0c42917
BLAKE2b-256 b877e55463d243c3ba15baafc5a07ad282b60b6282ba9d7fe0fea4a8c2cc5ecd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page