Skip to main content

MCP Server for FineData web scraping API - enables AI agents to scrape any website

Project description

FineData MCP Server

MCP (Model Context Protocol) server for FineData web scraping API.

Enables AI agents (Claude, Cursor, GPT, …) to scrape websites with:

  • Antibot bypass (Cloudflare, DataDome, PerimeterX, Akamai, …)
  • JavaScript rendering and browser actions
  • Captcha solving
  • Datacenter / ISP / residential / mobile proxies
  • Markdown output by default (LLM-optimized)
  • AI structured extraction
  • Local stdio or remote Streamable HTTP (+ OAuth 2.1)

Version: 0.2.0

Escalation ladder (recommended)

Prefer the cheapest step that works. Do not start with residential.

  1. base (~3 tok with default TLS antibot)
  2. stealth_antibot + datacenter (~10)
  3. stealth_premium + use_isp (~25) — default for protected sites (60% on hard targets vs 13% on datacenter)
  4. stealth_premium_headful + use_isp (~34) — hardest challenges
  5. use_residential / use_mobile — geo and IP-sensitive sites only
  6. residential / mobile — geo / IP-sensitive only

Gateway may apply a domain strategy that overrides engine/proxy; trust tokens_used in the response.

See docs/mcp-escalation-ladder-2026-07-29.md.

Installation

uvx (recommended)

curl -LsSf https://astral.sh/uv/install.sh | sh
FINEDATA_API_KEY=fd_xxx uvx finedata-mcp

pip

pip install finedata-mcp
FINEDATA_API_KEY=fd_xxx finedata-mcp

npx

npx -y @finedata/mcp-server

Cursor

~/.cursor/mcp.json (Windows: %USERPROFILE%\.cursor\mcp.json):

{
  "mcpServers": {
    "finedata": {
      "command": "uvx",
      "args": ["finedata-mcp"],
      "env": {
        "FINEDATA_API_KEY": "fd_your_api_key_here"
      }
    }
  }
}

Cursor deeplink (after publishing): install via MCP directory / “Add to Cursor”.

Remote (Streamable HTTP)

{
  "mcpServers": {
    "finedata": {
      "url": "https://mcp.finedata.ai/mcp",
      "headers": {
        "Authorization": "Bearer fd_your_api_key_here"
      }
    }
  }
}

OAuth 2.1 (Claude.ai / ChatGPT connectors): register via AS at https://api.finedata.ai, consent in the cabinet, then use the access token as Bearer.

Environment

Variable Required Default Description
FINEDATA_API_KEY stdio: yes API key
FINEDATA_API_URL no https://api.finedata.ai API base
FINEDATA_TIMEOUT no 180 HTTP client timeout (seconds)
FINEDATA_MCP_HOST HTTP 0.0.0.0 Bind host
FINEDATA_MCP_PORT HTTP 8080 Bind port
FINEDATA_OAUTH_ISSUER remote OAuth AS URL (gateway)
FINEDATA_MCP_RESOURCE_URL remote OAuth Public MCP URL
FINEDATA_JWT_SECRET remote OAuth Verify aud=mcp JWTs

Tools

Tool Purpose
scrape_url Sync scrape (markdown default)
scrape_async Async job (formats=['markdown'] default)
get_job_status Poll job (markdown, not raw HTML)
cancel_job Cancel job
list_jobs List jobs
batch_scrape Up to 100 URLs (string or {url,...} objects)
get_batch_status Batch progress
get_usage Period usage via api_tokens_used

Notable parameters: use_antibot, proxy_country, proxy_sticky, proxy_profile_id, auto_retry, stealth modes, formats, only_main_content, extract_*.

Async/batch: no csv/xlsx formats (sync only).

HTTP transport

finedata-mcp --transport http --host 0.0.0.0 --port 8080

Health: GET /health. Protected resource metadata: GET /.well-known/oauth-protected-resource.

Support

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

finedata_mcp-0.2.0.tar.gz (16.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

finedata_mcp-0.2.0-py3-none-any.whl (18.8 kB view details)

Uploaded Python 3

File details

Details for the file finedata_mcp-0.2.0.tar.gz.

File metadata

  • Download URL: finedata_mcp-0.2.0.tar.gz
  • Upload date:
  • Size: 16.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for finedata_mcp-0.2.0.tar.gz
Algorithm Hash digest
SHA256 4d45e67a7e5cb58c1193436b9ff6598e92db11294d57f3a43cfc65acb3123013
MD5 19aecdeb1b21558664ced2dfc3b32cba
BLAKE2b-256 fa80d656417c51adb57df4a94c0bfa928846ab362a8df5d7aef4568f024832de

See more details on using hashes here.

File details

Details for the file finedata_mcp-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: finedata_mcp-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 18.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for finedata_mcp-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 bdaa68e91758204b3e1a01534393d322a740d3c9a42125f54e7a01a0ce6bda33
MD5 df09ec6dd02cd432e6353107581950c9
BLAKE2b-256 a15e28899fea088bc02347323cff43a0159b6622d0cb3fa924c13d709b215394

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page