Skip to main content

MCP server for scraping Google AI Overviews via a Chrome extension relay

Project description

google-ai-scraper

MCP server for scraping Google AI Overviews via a Chrome extension relay. No API keys needed — uses your own Chrome browser.

How it works

MCP Client (Claude Code, Cursor, etc.)
    ↕ stdio
MCP Server + embedded FastAPI (this package)
    ↕ HTTP polling
Chrome Extension (installed separately)
    → opens background tab on google.com
    → scrapes AI Overview → Markdown
    → posts result back

Install

# Via uvx (recommended)
uvx google-ai-scraper

# Or pip
pip install google-ai-scraper

Prerequisites

  1. Chrome with the Google AI Overview Scraper extension installed
  2. Python 3.10+

MCP Client Configuration

Claude Code

Add to your project's .mcp.json or run claude mcp add:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Claude Desktop

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Cursor

Add to .cursor/mcp.json:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

MCP Tools

Tool Params Description
search query Search Google AI Overview. Returns markdown + citations + thread_id
follow_up query, thread_id Continue a conversation in an existing thread
health Check server + extension connectivity

Options

google-ai-scraper [--sse] [--no-server] [--port PORT]
Flag Default Description
--sse off Use SSE transport instead of stdio
--no-server off Don't start embedded FastAPI (if running separately)
--port 15551 FastAPI server port

Environment Variables

Variable Default Description
GOOGLE_AI_SCRAPER_URL http://127.0.0.1:15551 FastAPI server URL

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

google_ai_scraper-0.2.1.tar.gz (49.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

google_ai_scraper-0.2.1-py3-none-any.whl (6.5 kB view details)

Uploaded Python 3

File details

Details for the file google_ai_scraper-0.2.1.tar.gz.

File metadata

  • Download URL: google_ai_scraper-0.2.1.tar.gz
  • Upload date:
  • Size: 49.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for google_ai_scraper-0.2.1.tar.gz
Algorithm Hash digest
SHA256 d2b311c9b80a7b38075a6c10d03b16576c4e8f32d168ebab4c1661e3c2a8d350
MD5 4d84ad849cf2f2cbcf6d8686315a3efd
BLAKE2b-256 75777c3629eb59de8fc1f63324720041acfc1ac622e416d8904f4612254ce911

See more details on using hashes here.

File details

Details for the file google_ai_scraper-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: google_ai_scraper-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 6.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for google_ai_scraper-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 156b374b2b0055c1a697ca879da2b28d7eb03a88f40b7586ef68861bfc4d6f0a
MD5 ca10ec66a36c8318b5d16875538f6e72
BLAKE2b-256 61ecf7b372fafffd4ed64411809103ce7a2c9a04f7945abfd9afb1c6aea8598d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page