Skip to main content

Simple URL fetcher MCP server for Scrapling. Retrieves HTML/markdown from automation-blocking sites with three protection levels.

Project description

Scrapling Fetch MCP Server

A simple Model Context Protocol (MCP) server implementation that integrates with Scrapling for retrieving web content with advanced bot detection avoidance.

Intended Use

This tool is optimized for low volume retrieval of documentation and reference materials (text/html only) from websites that implement bot detection. It has not been designed or tested for general-purpose site scraping or data harvesting.

Features

  • Retrieve content from websites that implement advanced bot protection
  • Three protection levels (basic, stealth, max-stealth)
  • Two output formats (HTML, markdown)

Installation

Install scrapling

uv tool install scrapling
scrapling install
uv tool install scrapling-mcp

Usage with Claude

Add this configuration to your Claude client's MCP server configuration:

{
  "mcpServers": {
    "Cyber-Chitta": {
      "command": "uvx",
      "args": ["scrapling-fetch-mcp"]
    }
  }
}

Available Tools

scrapling-fetch

Fetch a URL with configurable bot-detection avoidance levels.

{
  "name": "scrapling-fetch",
  "arguments": {
    "url": "https://example.com",
    "mode": "stealth",
    "format": "markdown",
    "max_length": 5000,
    "start_index": 0
  }
}

Parameters

  • url (required): The URL to fetch
  • mode (optional, default: "basic"): Protection level
    • basic: Fast retrieval with minimal protection
    • stealth: Balanced protection against bot detection
    • max-stealth: Maximum protection with all anti-detection features
  • format (optional, default: "markdown"): Output format (options: html, markdown)
  • max_length (optional, default: 5000): Maximum number of characters to return
  • start_index (optional, default: 0): Character index to start from in the response (useful for paginated content)

License

Apache 2

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapling_fetch_mcp-0.1.0.tar.gz (116.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

scrapling_fetch_mcp-0.1.0-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file scrapling_fetch_mcp-0.1.0.tar.gz.

File metadata

  • Download URL: scrapling_fetch_mcp-0.1.0.tar.gz
  • Upload date:
  • Size: 116.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.5.29

File hashes

Hashes for scrapling_fetch_mcp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 3213f8a510db5796b75347a918f935469b092444a0723a359e43bc740d6ce206
MD5 e60770e2c72eb0d205445a440746eedd
BLAKE2b-256 652b75468b59c3675d444d4e6806e2026180c7c491d14b8b29f610f9e28e955e

See more details on using hashes here.

File details

Details for the file scrapling_fetch_mcp-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for scrapling_fetch_mcp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 9e9c2689ffec3aa8cb2d8c886964c10aa9fa1be592034826ef30bdb98a252635
MD5 fd3a33e6dba4526c99f7fa628fb984ba
BLAKE2b-256 024d689b88e45e3cb1475de256b2ddf46ac4614ff1528397e8dffcbcd25fcb1d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page