Skip to main content

MCP Server for FineData web scraping API - enables AI agents to scrape any website

Project description

FineData MCP Server

MCP (Model Context Protocol) server for FineData web scraping API.

Enables AI agents like Claude, Cursor, and GPT to scrape any website with:

  • Antibot Bypass - Cloudflare, DataDome, PerimeterX, and more
  • JavaScript Rendering - Full browser rendering with Playwright
  • Captcha Solving - reCAPTCHA, hCaptcha, Cloudflare Turnstile, Yandex
  • Proxy Rotation - 87K+ datacenter, residential, and mobile proxies
  • Smart Retry - Automatic retries with block detection

Installation

Using uvx (Recommended)

# Install uv if you haven't already
curl -LsSf https://astral.sh/uv/install.sh | sh

# Run directly with uvx
FINEDATA_API_KEY=fd_xxx uvx finedata-mcp

Using pip

pip install finedata-mcp

# Run
FINEDATA_API_KEY=fd_xxx finedata-mcp

Using npx

npx -y @finedata/mcp-server

Configuration

Cursor IDE

Step 1: Open Cursor Settings → MCP

Or create/edit ~/.cursor/mcp.json:

macOS/Linux:

mkdir -p ~/.cursor && nano ~/.cursor/mcp.json

Windows:

%USERPROFILE%\.cursor\mcp.json

Step 2: Add FineData MCP server:

{
  "mcpServers": {
    "finedata": {
      "command": "uvx",
      "args": ["finedata-mcp"],
      "env": {
        "FINEDATA_API_KEY": "fd_your_api_key_here"
      }
    }
  }
}

Step 3: Restart Cursor

Step 4: Test by asking the agent:

"Scrape https://example.com and show me the title"

Alternative: Using npx (if uv not installed)

{
  "mcpServers": {
    "finedata": {
      "command": "npx",
      "args": ["-y", "@finedata/mcp-server"],
      "env": {
        "FINEDATA_API_KEY": "fd_your_api_key_here"
      }
    }
  }
}

Note: npx requires Python 3.10+ and uv/pipx installed. uvx is recommended.


Claude Desktop

Step 1: Open config file:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Windows: %APPDATA%\Claude\claude_desktop_config.json

Step 2: Add MCP server:

{
  "mcpServers": {
    "finedata": {
      "command": "uvx",
      "args": ["finedata-mcp"],
      "env": {
        "FINEDATA_API_KEY": "fd_your_api_key_here"
      }
    }
  }
}

Step 3: Restart Claude Desktop


Environment Variables

Variable Required Description
FINEDATA_API_KEY Yes Your FineData API key
FINEDATA_API_URL No API URL (default: https://api.finedata.ai)
FINEDATA_TIMEOUT No Default timeout in seconds (default: 60)

Available Tools

scrape_url

Scrape content from any web page with antibot bypass.

scrape_url(
  url: "https://example.com",
  use_js_render: false,      # Enable Playwright for SPAs
  use_residential: false,    # Use residential proxy
  use_undetected: false,     # Use Undetected Chrome
  solve_captcha: false,      # Auto-solve captchas
  timeout: 60                # Timeout in seconds
)

Token costs:

  • Base request: 1 token
  • Antibot bypass: +2 tokens
  • JS rendering: +5 tokens
  • Residential proxy: +3 tokens
  • Captcha solving: +10 tokens

scrape_async

Submit an async scraping job for long-running requests.

scrape_async(
  url: "https://heavy-site.com",
  use_js_render: true,
  timeout: 120,
  callback_url: "https://your-webhook.com/callback"
)

Returns a job_id for status polling.

get_job_status

Get the status of an async scraping job.

get_job_status(job_id: "550e8400-e29b-41d4-a716-446655440000")

Statuses: pending, processing, completed, failed, cancelled

batch_scrape

Scrape multiple URLs in a single batch (up to 100 URLs).

batch_scrape(
  urls: ["https://example.com/1", "https://example.com/2"],
  use_js_render: false,
  callback_url: "https://your-webhook.com/batch-done"
)

get_usage

Get current API token usage.

get_usage()

Examples

Basic Scraping

Ask Claude or your AI agent:

"Scrape https://example.com and show me the content"

JavaScript Rendered Page

"Scrape https://spa-website.com with JavaScript rendering enabled"

Protected Site with Captcha

"Scrape https://protected-site.com using residential proxy and captcha solving"

Batch Scraping

"Scrape these URLs: https://example.com/1, https://example.com/2, https://example.com/3"

Pricing

FineData uses token-based pricing. Each feature adds tokens:

Feature Tokens
Base request 1
Antibot (TLS fingerprinting) +2
JS Rendering (Playwright) +5
Undetected Chrome +5
Residential Proxy +3
Mobile Proxy +4
reCAPTCHA / hCaptcha +10
Cloudflare Turnstile +12
Yandex SmartCaptcha +15

Get your API key and free trial tokens at finedata.ai.

Troubleshooting

"No module named finedata_mcp"

Install uv and use uvx:

curl -LsSf https://astral.sh/uv/install.sh | sh

"externally-managed-environment" on macOS

This happens with Homebrew Python. Use uvx instead of pip:

{
  "command": "uvx",
  "args": ["finedata-mcp"]
}

MCP server not appearing in Cursor

  1. Check ~/.cursor/mcp.json syntax (valid JSON)
  2. Ensure FINEDATA_API_KEY is set
  3. Restart Cursor completely
  4. Check Cursor Output → MCP for errors

Support

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

finedata_mcp-0.1.2.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

finedata_mcp-0.1.2-py3-none-any.whl (4.5 kB view details)

Uploaded Python 3

File details

Details for the file finedata_mcp-0.1.2.tar.gz.

File metadata

  • Download URL: finedata_mcp-0.1.2.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.2

File hashes

Hashes for finedata_mcp-0.1.2.tar.gz
Algorithm Hash digest
SHA256 5fee2c94fde9f8aa4c9e66f9fee5848f175aba970f9cbe0ca83620f3b01c0a62
MD5 0f1f6f5d145a5c5eeac7a351de8d4cb9
BLAKE2b-256 18da859d8cd56c00562d1969e6e3cba13dde544849d4bd957c080eb22b7790eb

See more details on using hashes here.

File details

Details for the file finedata_mcp-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: finedata_mcp-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.2

File hashes

Hashes for finedata_mcp-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0b2e41af9c31ac1769338aa556661c6e418996711ae79f5a49a0c931b36cbaa8
MD5 5a1ca29b72352db1131ed867348a3c04
BLAKE2b-256 830ea50fa7f5d8fa6cfd4b8cc1c30fc5c9128c352ed9f61d8e0e9b9511227a12

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page