Skip to main content

google-ai-scraper

MCP server for scraping Google AI Overviews via a Chrome extension relay. No API keys needed. It uses your own browser session and a shared local FastAPI backend.

How it works

MCP Client (Claude Code, Cursor, etc.)
    ↕ stdio or SSE
MCP Server (this package)
    ↕ HTTP
Shared FastAPI Backend (:15551)
    ↕ polling
Chrome Extension
    → opens background tab on google.com
    → scrapes AI Overview → Markdown
    → posts result back

In default stdio mode, each MCP client process auto-reuses or auto-starts the shared backend on 127.0.0.1:15551.

Install

# Via uvx (recommended)
uvx google-ai-scraper

# Or pip
pip install google-ai-scraper

Prerequisites

  1. Chrome with the Google AI Overview Scraper extension installed
  2. Python 3.10+
  3. Extension options pointed at http://localhost:15551

MCP Client Configuration

Claude Code

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Claude Desktop

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Cursor

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uvx",
      "args": ["google-ai-scraper"]
    }
  }
}

Local Source Checkout

{
  "mcpServers": {
    "google-ai-scraper": {
      "command": "uv",
      "args": [
        "run",
        "--directory",
        "/absolute/path/to/server",
        "google-ai-scraper"
      ]
    }
  }
}

MCP Tools

Tool Params Description
search query Search Google AI Overview. Returns markdown + citations + thread_id
follow_up query, thread_id Continue a conversation in an existing thread
health — Check server + extension connectivity

CLI Options

google-ai-scraper [--sse] [--no-server] [--backend] [--port PORT]
Flag Default Description
--sse off Run the MCP server with SSE transport instead of stdio
--no-server off Do not auto-start or reuse the shared FastAPI backend
--backend off Run only the shared FastAPI backend
--port 15551 FastAPI backend port

Environment Variables

Variable Default Description
GOOGLE_AI_SCRAPER_URL http://127.0.0.1:15551 FastAPI backend URL

Advanced Modes

Explicit Shared Backend

uv run google-ai-scraper --backend --port 15551

SSE Server

uv run google-ai-scraper --sse --no-server

Shared Backend + SSE Helper Script

cd server
./start-services.sh

This starts the shared backend on :15551 and the SSE endpoint on :8001.

License

MIT

Metadata

Release files for google-ai-scraper 0.2.14

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for google-ai-scraper 0.2.14
File Size Uploaded
google_ai_scraper-0.2.14.tar.gz 50.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for google-ai-scraper 0.2.14
File Interpreter ABI Platform
google_ai_scraper-0.2.14-py3-none-any.whl Python 3 none any Details

Total release size: 61.4 kB

Release files / google_ai_scraper-0.2.14.tar.gz

Download URL google_ai_scraper-0.2.14.tar.gz
Size 50.4 kB
Tags Source
SHA-256 checksum
How to use checksums
a9f3ececb54e307721abc6f4d40219bc8877e1f2978b2595dcef6320874c61ee
BLAKE2b-256 checksum
How to use checksums
1a5ed106ab796c031f3d18c2286f4b835f4afa98c252cd45709fd10f218ac7bc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.1 {"installer":{"name":"uv","version":"0.13.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / google_ai_scraper-0.2.14-py3-none-any.whl

Download URL google_ai_scraper-0.2.14-py3-none-any.whl
Size 11.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
67eb117ad70f43a71fa2084dd3a3a4a5957aaa0895be486d3443cbf59932c959
BLAKE2b-256 checksum
How to use checksums
ef38ff4676da9878f11de46f040b08a1b78e1ec9d231098a8c23c47ac39e1bdf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.1 {"installer":{"name":"uv","version":"0.13.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

0.2.16

2 release files

0.2.15

2 release files

This release

0.2.14 This release

2 release files

0.2.13

2 release files

0.2.12

2 release files

0.2.11

2 release files

0.2.10

2 release files

0.2.9

2 release files

0.2.8

2 release files

0.2.7

2 release files

0.2.6

2 release files

0.2.5

2 release files

0.2.4

2 release files

0.2.3

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page