Skip to main content

MCP Server for FineData web scraping API - enables AI agents to scrape any website

Project description

FineData MCP Server

MCP (Model Context Protocol) server for FineData web scraping API.

Enables AI agents (Claude, Cursor, GPT, …) to scrape websites with:

  • Antibot bypass (Cloudflare, DataDome, PerimeterX, Akamai, …)
  • JavaScript rendering and browser actions
  • Captcha solving
  • Datacenter / ISP / residential / mobile proxies
  • Markdown output by default (LLM-optimized)
  • AI structured extraction
  • Local stdio or remote Streamable HTTP (+ OAuth 2.1)

Version: 0.2.1

Escalation ladder (recommended)

Prefer the cheapest step that works. Do not start with residential.

  1. base (~3 tok with default TLS antibot)
  2. stealth_antibot + datacenter (~10)
  3. stealth_premium + use_isp (~25) — default for protected sites (60% on hard targets vs 13% on datacenter)
  4. stealth_premium_headful + use_isp (~34) — hardest challenges
  5. use_residential / use_mobile — geo and IP-sensitive sites only
  6. residential / mobile — geo / IP-sensitive only

Gateway may apply a domain strategy that overrides engine/proxy; trust tokens_used in the response.

See docs/mcp-escalation-ladder-2026-07-29.md.

Installation

uvx (recommended)

curl -LsSf https://astral.sh/uv/install.sh | sh
FINEDATA_API_KEY=fd_xxx uvx finedata-mcp

pip

pip install finedata-mcp
FINEDATA_API_KEY=fd_xxx finedata-mcp

npx

npx -y @finedata/mcp-server

Cursor

~/.cursor/mcp.json (Windows: %USERPROFILE%\.cursor\mcp.json):

{
  "mcpServers": {
    "finedata": {
      "command": "uvx",
      "args": ["finedata-mcp"],
      "env": {
        "FINEDATA_API_KEY": "fd_your_api_key_here"
      }
    }
  }
}

Cursor deeplink (after publishing): install via MCP directory / “Add to Cursor”.

Remote (Streamable HTTP)

{
  "mcpServers": {
    "finedata": {
      "url": "https://mcp.finedata.ai/mcp",
      "headers": {
        "Authorization": "Bearer fd_your_api_key_here"
      }
    }
  }
}

OAuth 2.1 (Claude.ai / ChatGPT connectors): register via AS at https://api.finedata.ai, consent in the cabinet, then use the access token as Bearer.

Environment

Variable Required Default Description
FINEDATA_API_KEY stdio: yes API key
FINEDATA_API_URL no https://api.finedata.ai API base
FINEDATA_TIMEOUT no 180 HTTP client timeout (seconds)
FINEDATA_MCP_HOST HTTP 0.0.0.0 Bind host
FINEDATA_MCP_PORT HTTP 8080 Bind port
FINEDATA_OAUTH_ISSUER remote OAuth AS URL (gateway)
FINEDATA_MCP_RESOURCE_URL remote OAuth Public MCP URL
FINEDATA_JWT_SECRET remote OAuth Verify aud=mcp JWTs

Tools

Tool Purpose
scrape_url Sync scrape (markdown default)
scrape_async Async job (formats=['markdown'] default)
get_job_status Poll job (markdown, not raw HTML)
cancel_job Cancel job
list_jobs List jobs
batch_scrape Up to 100 URLs (string or {url,...} objects)
get_batch_status Batch progress
get_usage Period usage via api_tokens_used

Notable parameters: use_antibot, proxy_country, proxy_sticky, proxy_profile_id, auto_retry, stealth modes, formats, only_main_content, extract_*.

Async/batch: no csv/xlsx formats (sync only).

HTTP transport

finedata-mcp --transport http --host 0.0.0.0 --port 8080

Health: GET /health. Protected resource metadata: GET /.well-known/oauth-protected-resource.

Support

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

finedata_mcp-0.2.1.tar.gz (16.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

finedata_mcp-0.2.1-py3-none-any.whl (18.9 kB view details)

Uploaded Python 3

File details

Details for the file finedata_mcp-0.2.1.tar.gz.

File metadata

  • Download URL: finedata_mcp-0.2.1.tar.gz
  • Upload date:
  • Size: 16.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for finedata_mcp-0.2.1.tar.gz
Algorithm Hash digest
SHA256 dcd783f66b1ecf66d3c082344c77fc557c0863275a63755b1b355c8b6b080ffd
MD5 c42ea11f5e171c0e73061a34ad852096
BLAKE2b-256 1e6be60a911ed0fce17f8d97f40e6561db9ca719438afe991818bdde03ef4c0e

See more details on using hashes here.

File details

Details for the file finedata_mcp-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: finedata_mcp-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 18.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for finedata_mcp-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 68087cbb53c5add54c7e16510e49f593cfe578629174028f1a3d894d433f1677
MD5 a1b1f08bb72ed47299f93c060b38ce59
BLAKE2b-256 519d114428cf152e6873a089d6561280d1fded6681a090b37d018a7a69330f86

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page