MCP server for scraping Google AI Overviews via a Chrome extension relay
Project description
google-ai-scraper
MCP server for scraping Google AI Overviews via a Chrome extension relay. No API keys needed. It uses your own browser session and a shared local FastAPI backend.
How it works
MCP Client (Claude Code, Cursor, etc.)
↕ stdio or SSE
MCP Server (this package)
↕ HTTP
Shared FastAPI Backend (:15551)
↕ polling
Chrome Extension
→ opens background tab on google.com
→ scrapes AI Overview → Markdown
→ posts result back
In default stdio mode, each MCP client process auto-reuses or auto-starts the shared backend on 127.0.0.1:15551.
Install
# Via uvx (recommended)
uvx google-ai-scraper
# Or pip
pip install google-ai-scraper
Prerequisites
- Chrome with the Google AI Overview Scraper extension installed
- Python 3.10+
- Extension options pointed at
http://localhost:15551
MCP Client Configuration
Claude Code
{
"mcpServers": {
"google-ai-scraper": {
"command": "uvx",
"args": ["google-ai-scraper"]
}
}
}
Claude Desktop
{
"mcpServers": {
"google-ai-scraper": {
"command": "uvx",
"args": ["google-ai-scraper"]
}
}
}
Cursor
{
"mcpServers": {
"google-ai-scraper": {
"command": "uvx",
"args": ["google-ai-scraper"]
}
}
}
Local Source Checkout
{
"mcpServers": {
"google-ai-scraper": {
"command": "uv",
"args": [
"run",
"--directory",
"/absolute/path/to/server",
"google-ai-scraper"
]
}
}
}
MCP Tools
| Tool | Params | Description |
|---|---|---|
search |
query |
Search Google AI Overview. Returns markdown + citations + thread_id |
follow_up |
query, thread_id |
Continue a conversation in an existing thread |
health |
— | Check server + extension connectivity |
CLI Options
google-ai-scraper [--sse] [--no-server] [--backend] [--port PORT]
| Flag | Default | Description |
|---|---|---|
--sse |
off | Run the MCP server with SSE transport instead of stdio |
--no-server |
off | Do not auto-start or reuse the shared FastAPI backend |
--backend |
off | Run only the shared FastAPI backend |
--port |
15551 | FastAPI backend port |
Environment Variables
| Variable | Default | Description |
|---|---|---|
GOOGLE_AI_SCRAPER_URL |
http://127.0.0.1:15551 |
FastAPI backend URL |
Advanced Modes
Explicit Shared Backend
uv run google-ai-scraper --backend --port 15551
SSE Server
uv run google-ai-scraper --sse --no-server
Shared Backend + SSE Helper Script
cd server
./start-services.sh
This starts the shared backend on :15551 and the SSE endpoint on :8001.
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file google_ai_scraper-0.2.7.tar.gz.
File metadata
- Download URL: google_ai_scraper-0.2.7.tar.gz
- Upload date:
- Size: 52.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d9d8ff1830a1205b44db3e88c7ff7c2ce1a161aa8cd808343beb0c6257f59b94
|
|
| MD5 |
e96a996ca781b0dd25c91db185307b27
|
|
| BLAKE2b-256 |
a9b4338fb3988911829ee1aa0bd065c7046c59e7d1285e8df7e633dd7fbdf520
|
File details
Details for the file google_ai_scraper-0.2.7-py3-none-any.whl.
File metadata
- Download URL: google_ai_scraper-0.2.7-py3-none-any.whl
- Upload date:
- Size: 9.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d7d299e5ddca32bb74d4efd4fbd4e3443bf856251957adfce99762b212966af9
|
|
| MD5 |
03e052247b2064e0482478316e909aec
|
|
| BLAKE2b-256 |
4ad1892027dddee233fa873a2d5296e885e38d0be9c584732c97d24171d74d29
|