Source-only multi-provider web search, extraction, evidence receipts, and onboarding for MCP clients
Project description
๐ web-search-plus-mcp
Give your agent the web โ as real sources, never a made-up answer. web-search-plus-mcp is the standalone MCP server for Web Search Plus: drop it into Claude Desktop, Cursor, NanoBot, Hermes, or any MCP-compatible host, and your agent can search and read pages across the providers you choose โ and always see where each result came from.
New in 3.3 โ better evidence, less waiting:
- ๐งฉ Heading-aware extraction spans keep the useful body beneath a matching heading instead of returning an isolated keyword sentence.
- ๐งพ Provenance-safe result enrichment merges corroborating snippets without losing observation IDs, then adds explainable
source_typeandfetch_priorityhints. - โก Quality-quorum Research harvests providers as they finish and can stop waiting once enough diverse evidence exists, while every preempted provider remains visible.
All sources, zero invented answers.
The heading-aware spans, multi-observation enrichment, and Research quorum are
independent WSP/MCP implementations inspired by
Hound/Master-Fetch v11.2.0,
the MIT-licensed project by Bishesh Bhandari (dondai1234).
This is respectful upstream collaboration and attribution, not a Hound fork or
a claim that the upstream work is Robby's code.
Version note: web-search-plus-mcp 3.3.0 aligns its public version with the portable source-only Web Search Plus v3.3.0 engine. This is a one-time version-line realignment from MCP 1.2.0, not a breaking change to the two MCP tools. The Hermes plugin remains a separate product; its plugin-loader, Operator Console, receipts journal, and release commands are not exposed by the standalone MCP server.
See the 3.3 release notes for compatibility, upgrade, and attribution details.
โจ Features
- 13 search providers + auto-routing โ source-result providers only; answer-only endpoints are rejected instead of being presented as search
- 9 extract providers with private-target protection โ Tavily, Exa, Linkup, Parallel, Firecrawl, You.com, Keenable, Serper, Hound
- Optional keyless Hound sidecar โ local metasearch and browser-backed extraction over loopback MCP; explicit-only by default
- Additive v3 evidence contract โ source observations, provider attempts, routing receipts, cache provenance, typed errors, and deterministic legacy projections
- Bounded extraction context โ long pages return a bounded preview plus a page-on-demand reference to the stored full text
- Classic Routing v2 authority โ registry-backed routing for multilingual/current, docs/API, arXiv, CVE/security, local/shopping, and OSS discovery
- Quality reports + doctor checks โ optional routing/result diagnostics plus compact offline health checks for configured providers/cache
- Research mode โ opt-in multi-provider search + top-source extraction with a time budget
- Quality-quorum research โ harvest provider completions as they arrive, stop waiting only after a conservative diversity threshold, and report every preempted provider explicitly
- 3.1 policy layer โ budget preflight, diversity-aware reranking, self-hosted profiles, shadow-policy observations, extraction cache identity v6, and SQLite state schema v3
- Provider SDK โ zero-core-edit provider discovery through
providers.dwith fail-closed startup diagnostics and shared conformance checks - Semantic extraction spans โ deterministic query-ranked spans through
web_extract(spans=true, spans_query=...), with bounded heading sections that retain the useful body below a matching heading - Provenance-safe result enrichment โ merged cross-provider snippet fragments retain observation IDs; additive
source_typeandfetch_priorityexplain what to fetch next - Onboarding CLI โ
status,list,setup, and persistent routingconfighelpers for MCP env/config wiring - Zero-install run โ
uvx web-search-plus-mcp - MCP-native โ stdio server exposing stable
web_searchandweb_extracttools
What changes in 1.0
- Native Perplexity and Kilo Perplexity answer endpoints are removed from the public provider enums because they do not expose a verified source-only mode.
- The two MCP tool names and their legacy result fields remain stable. v3 evidence, attempts, receipts, limits, stored-content references, warnings, and typed errors are additive.
- Existing config entries for retired answer providers are ignored in provider lists; retired default/fallback values are replaced in memory with
serperand reported as a migration warning. - The MCP server keeps its stdio/subprocess boundary. Hermes-specific in-process plugin loading and Operator Console surfaces are intentionally not ported.
See Migrating to 1.0 before upgrading an existing 0.x installation.
๐ Quick Start
# Run the MCP server instantly with uvx
uvx web-search-plus-mcp
# Or install globally
pip install web-search-plus-mcp
web-search-plus-mcp
At least one configured provider is required. Most providers use credentials; Hound can instead run as a separately installed keyless local sidecar. Keyless does not mean offline, anonymous, unlimited, or free of local operating cost.
๐งญ Easier onboarding
Check configured providers:
web-search-plus-mcp status
List providers or presets:
web-search-plus-mcp list providers
web-search-plus-mcp list presets
Write a starter .env template and print a canonical MCP stdio snippet:
web-search-plus-mcp setup --preset starter
The recommended starter preset is You.com + Serper + Linkup. It gives a practical source-only baseline for fast current search, Google-style discovery, and extraction workflows without wiring every provider on day one.
status returns a non-zero exit code when no search provider is configured, which makes it usable as a config check in scripts.
Persistent routing preferences live in config.json rather than .env:
web-search-plus-mcp config show
web-search-plus-mcp config set-default you # strict fixed-provider mode
web-search-plus-mcp config set-routing on # restore auto-routing
web-search-plus-mcp config set-priority you,serper,exa,firecrawl,tavily,linkup,parallel,brave,keenable
web-search-plus-mcp config set-extract-priority serper,tavily,exa,linkup,parallel,firecrawl,you,keenable
web-search-plus-mcp config set-fallback serper
web-search-plus-mcp config disable parallel
web-search-plus-mcp config enable parallel
web-search-plus-mcp config set-auto-allow parallel on
web-search-plus-mcp config set-threshold 0.45
web-search-plus-mcp config reset --yes
Use --config-path /path/to/config.json or WEB_SEARCH_PLUS_CONFIG=/path/to/config.json for isolated MCP host installs. Provider secrets stay in environment variables; routing behavior stays in config.json. Search and extraction priorities are independent. If an extraction priority lists only selected providers, the remaining extract-capable providers are appended in the public registry order.
Other presets:
minimalโ You.com onlyleanโ You.com + Linkupstarterโ You.com + Serper + Linkupallโ every supported provider env var
โ๏ธ MCP host config
Canonical stdio snippet for Claude Desktop, Cursor, NanoBot, or Hermes native MCP:
{
"mcpServers": {
"web-search-plus": {
"command": "uvx",
"args": ["web-search-plus-mcp"],
"env": {
"YOU_API_KEY": "your_you_key",
"SERPER_API_KEY": "your_serper_key",
"LINKUP_API_KEY": "your_linkup_key"
}
}
}
}
Common places to paste this snippet:
- Claude Desktop macOS:
~/Library/Application Support/Claude/claude_desktop_config.json - Claude Desktop Windows:
%APPDATA%\\Claude\\claude_desktop_config.json - Claude Desktop Linux:
~/.config/Claude/claude_desktop_config.json - Cursor: project/user MCP config using the same
mcpServersshape - Hermes native MCP:
~/.hermes/config.yamlundermcp_serverswith equivalent command/env fields
You can also place a .env file next to the package/project with the same variables.
๐ Search Providers
- You.com โ fast source-result provider for current and multilingual search
- Serper โ Google-style facts, news, shopping, local queries
- Exa โ semantic discovery, GitHub/docs, arXiv/academic, and OSS discovery
- Firecrawl โ web search plus scrape-ready content
- Parallel โ explicit-only LLM-ready web search with long excerpts (
PARALLEL_API_KEY,auto_allow=false) - Tavily โ research and analysis
- Linkup โ source-backed grounding/citations
- Brave โ explicit-only independent web index by default (
BRAVE_API_KEY,auto_allow=false) - SearXNG โ privacy-first self-hosted meta-search
- SerpBase โ explicit-only Google SERP API (
SERPBASE_API_KEY,auto_allow=false) - Querit โ explicit-only multilingual, real-time AI search (
QUERIT_API_KEY,auto_allow=false) - Keenable โ independent web index with search and extraction (
KEENABLE_API_KEY, or opt-in keyless public tier; off by default) - Hound โ explicit-only local keyless metasearch through a separately installed loopback MCP sidecar (
HOUND_MCP_URL)
๐ Extract Providers
- Tavily โ public default first choice; fastest reliable extraction in the v2.1 benchmark
- Exa โ fast contents API, strong for docs/academic pages
- Linkup โ clean markdown and source-grounded fetches
- Parallel โ docs-focused fallback with full-content defaults of 60k characters per result / 120k total
- Firecrawl โ robust scrape fallback, useful for JS-heavy/blocked pages
- You.com โ LLM-ready snippets/content where available
- Keenable โ keyed or explicitly opted-in public extraction
- Serper โ fast webpage scraper extraction
- Hound โ explicit-only local fetch, browser rendering, PDF, and OCR fallback through MCP
auto_routing.extract_provider_priority can override the auto-extraction order without changing search routing. Explicit provider calls still try the requested provider first.
Keenable keyless public access
Keenable exposes authenticated endpoints via KEENABLE_API_KEY. It also has keyless /public endpoints, but those are opt-in and disabled by default. Without a key, Keenable is treated as unconfigured unless you explicitly enable public egress:
{ "keenable": { "allow_public": true } }
or set:
KEENABLE_ALLOW_PUBLIC=1
Use an API key for private or production use. The public endpoint sends queries and fetched URLs to a shared unauthenticated service and remains near the tail of the public default fallback order unless the operator configures a different extraction priority.
Hound local keyless sidecar
Hound / Master Fetch is an
independent MIT-licensed project created and maintained by
Bishesh Bhandari (dondai1234). It is not
bundled with this package. Web Search Plus connects to a separately installed
Hound service through an uncredentialed loopback-only MCP endpoint.
Hound avoids commercial search API credentials, but uses local resources and
public network egress; engines may throttle or change behavior, browser-backed
fetches can be slow, and no SLA is implied. Hound therefore remains
explicit-only unless the operator enables auto_allow.
See the Hound setup and security guide for installation, configuration, trade-offs, and tested versions.
Private/internal extraction target guard
web_extract blocks user-supplied target URLs that point at private or internal networks before any provider is called. This covers loopback, RFC1918, CGNAT/shared-address ranges, IPv6 local/mapped-private ranges, multicast, cloud metadata hosts, and hostnames resolving to private/internal IPs.
Operator-configured provider endpoints are separate: local Firecrawl-compatible backends can still run on 127.0.0.1 through provider config. If you intentionally need to extract trusted intranet URLs, opt in explicitly:
{ "extract": { "allow_private_urls": true } }
Leave this off for public/agent-controlled URL extraction.
GroktoCrawl / local Firecrawl-compatible backends
The Firecrawl provider can target a local Firecrawl-v2-compatible backend by overriding its search and scrape URLs in config.json. For example, a local GroktoCrawl instance listening on 127.0.0.1:8080 can be used without adding a separate provider:
{
"firecrawl": {
"api_url": "http://127.0.0.1:8080/v2/search",
"scrape_url": "http://127.0.0.1:8080/v2/scrape"
}
}
Keep FIRECRAWL_API_KEY configured if your backend enforces bearer authentication; local development instances may ignore the header. This does not make GroktoCrawl the default and does not claim coverage for every Firecrawl endpoint.
๐ MCP Tool Reference
This MCP server exposes exactly two stable, source-only tools: web_search and web_extract. Use web_search for source discovery and let the MCP host synthesize from those sources when needed; the server itself does not generate answers or truth claims.
The Hermes plugin exposes the same stable capability as web_search_plus and web_extract_plus; the names differ because MCP and Hermes use different tool surfaces.
web_search
Use for source discovery, current events, prices, weather, sports lineups, schedules, and whenever you want the raw search landscape first.
Parameters:
queryโ required search queryproviderโauto,serper,serpbase,brave,tavily,querit,linkup,exa,firecrawl,parallel,you,searxng,keenable,houndcountโ results to return, default5, max20depthโ Exa depth:normal,deep,deep-reasoningtime_rangeโhour,day,week,month,yearfreshnessโ unifiedday,week,month, oryearrecency requestsearch_typeโsearchor Serper-nativenewscountry/languageโ explicit locale overridesinclude_domains/exclude_domainsโ domain allow/deny listsmodeโnormalorresearchquality_reportโ include routing/result diagnosticsresearch_time_budgetโ best-effort wall-clock budget for research mode
Example MCP arguments:
{
"query": "latest AI hardware news",
"provider": "auto",
"count": 5,
"quality_report": true
}
web_extract
Parameters:
urlsโ required list of URLsproviderโauto,tavily,exa,linkup,parallel,firecrawl,you,keenable,serper,houndformatโmarkdownorhtmlinclude_imagesโ include image metadata when supportedinclude_raw_htmlโ include raw HTML when supportedrender_jsโ render JavaScript before extraction when supportedspansโ select deterministic semantic spans from extracted textspans_queryโ optional query used to rank semantic spans
Example MCP arguments:
{
"urls": ["https://example.com"],
"provider": "auto",
"format": "markdown"
}
๐ง Classic Routing v2 examples
ๆฑไบฌ AI ใใฅใผใน ไปๆฅโ You.com multilingual/current searcharXiv 2024 LLM scaling lawsโ Exa academic discoveryCVE-2025 openssl advisoryโ Serper security/current searchbest bookshelf speakers under 1000 EUR Austriaโ Serper/Firecrawl shopping/local searchopen source alternatives to Linearโ Exa/Firecrawl OSS discoveryrecent RAG vs fine-tuning benchmark sourcesโ source-result discovery; the MCP host may synthesize from returned sources
Guarded providers can still be called explicitly. To let one participate in provider="auto", opt in:
web-search-plus-mcp config set-auto-allow parallel on
web-search-plus-mcp config set-auto-allow parallel off
web-search-plus-mcp config set-auto-allow hound on
web-search-plus-mcp config set-auto-allow hound off
Development
python -m pip install -e ".[test]"
python -m pytest tests/ -q -p no:cacheprovider
ruff check .
python -m build
The GitHub Actions workflow runs the test suite on Python 3.10, 3.11, and 3.12, then verifies Ruff, byte-compilation, wheel creation, and source-distribution creation.
Credits
Built on the Web Search Plus routing engine and packaged as a standalone MCP server.
License
MIT ยฉ 2026 robbyczgw-cla
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file web_search_plus_mcp-3.3.0.tar.gz.
File metadata
- Download URL: web_search_plus_mcp-3.3.0.tar.gz
- Upload date:
- Size: 1.6 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a84dde338b81c348caea8133b516b41b97d2c23beef46b65c63759a6a631abe4
|
|
| MD5 |
01e7ed9ce3581b0e5ba6a74b0bee8d45
|
|
| BLAKE2b-256 |
92f6bc61e04fbbe1b60912e033bfe5ff09a97cc582683743e7ddffc4dea10dcf
|
File details
Details for the file web_search_plus_mcp-3.3.0-py3-none-any.whl.
File metadata
- Download URL: web_search_plus_mcp-3.3.0-py3-none-any.whl
- Upload date:
- Size: 222.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
657b1360d67c778f353a9cbcc6375f8e04011cd83255826365029e1d645944f9
|
|
| MD5 |
cb75bda1f45d5f7160fec8b926bd62bc
|
|
| BLAKE2b-256 |
6a133f939cd4feb2cfd31c31b00d933313bd4fe0bcf475f61669832250fdbce9
|