Skip to main content

MCP server for scraping Google AI Overviews via a Chrome extension relay

Project description

google-ai-scraper

MCP server for scraping Google AI Overviews via a Chrome extension relay. No API keys needed — uses your own Chrome browser.

How it works

MCP Client (Claude Code, Cursor, etc.)
    ↕ stdio
MCP Server + embedded FastAPI (this package)
    ↕ HTTP polling
Chrome Extension (installed separately)
    → opens background tab on google.com
    → scrapes AI Overview → Markdown
    → posts result back

Install

# Via uvx (recommended)
uvx google-ai-scraper

# Or pip
pip install google-ai-scraper

Prerequisites

  1. Chrome with the Google AI Overview Scraper extension installed
  2. Python 3.10+

MCP Client Configuration

Claude Code

Add to your project's .mcp.json or run claude mcp add:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Claude Desktop

Add to claude_desktop_config.json:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Cursor

Add to .cursor/mcp.json:

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

MCP Tools

Tool Params Description
search query Search Google AI Overview. Returns markdown + citations + thread_id
follow_up query, thread_id Continue a conversation in an existing thread
health Check server + extension connectivity

Options

google-ai-scraper [--sse] [--no-server] [--port PORT]
Flag Default Description
--sse off Use SSE transport instead of stdio
--no-server off Don't start embedded FastAPI (if running separately)
--port 15551 FastAPI server port

Environment Variables

Variable Default Description
GOOGLE_AI_SCRAPER_URL http://127.0.0.1:15551 FastAPI server URL

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

google_ai_scraper-0.2.4.tar.gz (49.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

google_ai_scraper-0.2.4-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file google_ai_scraper-0.2.4.tar.gz.

File metadata

  • Download URL: google_ai_scraper-0.2.4.tar.gz
  • Upload date:
  • Size: 49.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.11 {"installer":{"name":"uv","version":"0.10.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for google_ai_scraper-0.2.4.tar.gz
Algorithm Hash digest
SHA256 63d14853cc8bb6f7c06bb07023fdcd7f601a8983a38d72fb3770689d735e3ed3
MD5 f5753e9eced7742f471a07163bae5a2b
BLAKE2b-256 2b98bb8a9409de2c5e3028ab745fd25fbce6565e07c9977e7d1ce87e235bbfc3

See more details on using hashes here.

File details

Details for the file google_ai_scraper-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: google_ai_scraper-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.11 {"installer":{"name":"uv","version":"0.10.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for google_ai_scraper-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 878e3fc301c3351ea5364f9d56cd6709a87ac055208fe64666a5378c29334d74
MD5 4f752b325dfb96aca1cca810cb368cf5
BLAKE2b-256 977679cc8db5da2f0c7660063bfbc9550bc6ddcfcc418437012f4bc8c6e6045f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page