Skip to main content

Agent Web Search

One web-search tool for AI agents, backed by multiple independent providers.

English | 简体中文

Python 3.10+ PyPI CI MCP 2.x License: MIT

Works with Codex CLI, Claude Code, OpenCode, Hermes, ordinary shell scripts, Python applications, and remote Streamable HTTP MCP clients.

Providers · Quick start · Remote MCP · Tool interface · Configuration · Integrations · Architecture · Development


Agent Web Search exposes one provider-neutral web_search tool. It dispatches independent providers concurrently, normalizes their responses, keeps partial failures isolated, and lets the calling agent choose which enabled providers to use for each request.

Agent / MCP client
        │
        ▼
    web_search
        │
        ▼
  SearchEngine ──┬── DDGS
                 ├── Exa
                 ├── Parallel
                 ├── ARK
                 ├── Brave
                 ├── Gemini
                 ├── Grok
                 ├── Perplexity
                 ├── Tavily
                 └── You.com

Providers

Free, keyless defaults: DDGS, Exa, and Parallel all work without an API key. Exa and Parallel automatically use their free MCP transports until a paid API key is provided.

Provider Search backend API key Enabled by default
DDGS DuckDuckGo search Free · no key required Yes
Exa Paid Search API or free MCP fallback Free without key · optional EXA_API_KEY Yes
Parallel Free MCP or paid LLM-optimized search Free without key · optional PARALLEL_API_KEY Yes
ARK (Recommended) Volcengine ARK Responses API + web_search ARK_API_KEY No
Brave Brave Search API BRAVE_SEARCH_API_KEY No
Gemini Google Search grounding GEMINI_API_KEY No
Grok xAI web search and X Search XAI_API_KEY No
Perplexity Native structured Search API PERPLEXITY_API_KEY No
Tavily Tavily Search API TAVILY_API_KEY No
You.com Unified web and news search YDC_API_KEY No

The provider architecture is intentionally open: another search-capable backend can be added without changing the MCP, Hermes, CLI, or Python-facing interfaces.

Quick start

Install from PyPI using whichever Python package runner you already have:

# Standard Python installation
python -m pip install agent-web-search-mcp

# Isolated persistent installation
pipx install agent-web-search-mcp

# Run without a persistent installation
uvx agent-web-search-mcp

pip and pipx install both commands below. uvx runs the command named in its invocation directly.

Run a search without configuring a paid API key after a persistent install:

agent-web-search "What changed in the latest OpenAI Codex CLI?"

Or run the CLI through uvx without installing it:

uvx --from agent-web-search-mcp agent-web-search \
  "What changed in the latest OpenAI Codex CLI?"

Or start the stdio MCP server for an MCP client:

agent-web-search-mcp

To use uvx directly from an MCP client without installing the package first, configure the client to run uvx agent-web-search-mcp. For example:

{
  "mcpServers": {
    "agent-web-search": {
      "command": "uvx",
      "args": ["agent-web-search-mcp"]
    }
  }
}
Install the latest development version from GitHub
pipx install 'git+https://github.com/JerryLiu369/agent-web-search.git'

[!IMPORTANT] Do not place API keys in shell history, source code, Git commits, screenshots, or checked-in MCP configuration. Export them from a secret manager or a local environment file that is not committed.

Remote MCP over HTTPS

The same agent-web-search-mcp command supports both MCP transports. It keeps stdio as the zero-argument default and enables stateless Streamable HTTP with a transport switch:

# Generate a deployment token once.
python -c "import secrets; print(secrets.token_urlsafe(32))"

export AGENT_WEB_SEARCH_AUTH_TOKEN="replace-with-the-generated-token"
agent-web-search-mcp --transport http

The HTTP server exposes POST /mcp and public GET /healthz. /mcp requires the deployment Bearer Token by default and never creates an MCP-Session-Id.

Remote MCP client example:

{
  "mcpServers": {
    "agent-web-search": {
      "url": "https://your-deployment.example/mcp",
      "headers": {
        "Authorization": "Bearer your-deployment-token"
      }
    }
  }
}

Deploy

Deploy with Vercel Deploy on Railway Deploy to Render

Every public deployment must set AGENT_WEB_SEARCH_AUTH_TOKEN to at least 32 characters. Provider keys remain optional server-side environment variables.

Generic Docker deployment:

docker build -t agent-web-search .
docker run --rm -p 8000:8000 \
  -e AGENT_WEB_SEARCH_AUTH_TOKEN="replace-with-a-32-character-token" \
  agent-web-search

Tool interface

The MCP server and Hermes plugin register one tool named web_search.

Argument Type Required Default Description
query string Yes Complete natural-language search question
max_results integer, 1–20 No 10 Desired result or citation count
max_keyword integer, 1–10 No 3 Desired maximum number of search queries or keywords
time_range d, w, m, y No Past day, week, month, or year
providers string array No All enabled Narrow the request to enabled providers
grok_search_mode web_search, x_search, both No web_search Available only when Grok is enabled

Example call:

{
  "query": "GPU kernel generation papers from the past month",
  "max_results": 5,
  "time_range": "m",
  "providers": ["ddgs", "exa"]
}

Provider selection has two levels:

  1. AGENT_WEB_SEARCH_PROVIDERS defines the provider set when the process starts.
  2. The request-level providers argument may narrow that set, but cannot enable a provider that was disabled at startup.

Failed providers are omitted from successful responses. If every selected provider fails, MCP returns a tool error with the stable code all_providers_failed and includes per-provider diagnostics.

Configuration

Configuration is read from environment variables when the CLI, MCP server, or Hermes plugin starts. Restart the process after changing provider settings.

General settings

Variable Default Purpose
AGENT_WEB_SEARCH_PROVIDERS ddgs,exa,parallel Comma-separated startup-enabled provider set
AGENT_WEB_SEARCH_TIMEOUT 60 Per-provider timeout in seconds

Example:

export AGENT_WEB_SEARCH_PROVIDERS="ddgs,exa,brave"
export AGENT_WEB_SEARCH_TIMEOUT="30"
$env:AGENT_WEB_SEARCH_PROVIDERS = "ddgs,exa,brave"
$env:AGENT_WEB_SEARCH_TIMEOUT = "30"

HTTP transport settings

Variable Default Purpose
AGENT_WEB_SEARCH_MCP_TRANSPORT stdio stdio or http; --transport may override it
AGENT_WEB_SEARCH_HTTP_HOST 0.0.0.0 HTTP bind host for container deployments
AGENT_WEB_SEARCH_HTTP_PORT PORT or 8000 HTTP bind port; explicit value overrides platform PORT
AGENT_WEB_SEARCH_AUTH_TOKEN Required HTTP Bearer Token, at least 32 characters
AGENT_WEB_SEARCH_ALLOW_ANONYMOUS false Explicitly disables HTTP auth for trusted/demo environments
AGENT_WEB_SEARCH_HTTP_ALLOWED_HOSTS Optional comma-separated Host allowlist
AGENT_WEB_SEARCH_HTTP_ALLOWED_ORIGINS Optional comma-separated Origin allowlist; requires allowed hosts
AGENT_WEB_SEARCH_HTTP_LOG_LEVEL info Uvicorn log level for the container server

HTTP settings remain environment-only; the deployment files do not introduce a second application configuration format.

Provider settings

Default providers are listed first; optional providers then follow alphabetical order.

1. DDGS

DDGS uses DuckDuckGo and requires no API key or provider-specific environment variables. The ddgs Python dependency is installed with the package.

2. Exa

Exa supports both paid and keyless modes.

Variable Required Purpose
EXA_API_KEY No Uses the paid Search API when present
EXA_MCP_URL No Overrides the free MCP endpoint when no API key is set

Without EXA_API_KEY, Exa falls back to its free MCP endpoint on a best-effort basis. The paid API generally provides higher quota and reliability.

3. Parallel

Parallel returns information-dense excerpts ranked for LLM context. One parallel provider automatically selects its transport:

  • Without a key, it uses Parallel's free Search MCP.
  • With PARALLEL_API_KEY, it uses the paid Search REST API.

Both transports map excerpts into the common result description, so the calling agent does not need to distinguish parallel-free from parallel.

Variable Required Purpose
PARALLEL_API_KEY No Enables the paid API; omit it to use the free MCP

Parallel is enabled by default and its key is optional.

4. ARK (Recommended)

Volcengine ARK uses model-backed search grounding through the Responses API. Add ark to AGENT_WEB_SEARCH_PROVIDERS after providing the key.

Variable Required Purpose
ARK_API_KEY Yes One key, or multiple comma/newline-separated keys
AGENT_WEB_SEARCH_ARK_MODELS No Comma/newline-separated ARK model IDs

One model stays fixed; multiple models are selected round-robin for successive requests. When multiple ARK keys are configured, a key is selected per request.

Optional Volcengine collaboration rewards information

Agent Web Search does not require participation in a rewards program. ARK users may optionally review the official Volcengine Collaboration Rewards Program. Quota, supported models, validity periods, and data-authorization terms can change. Check the official terms before opting in. Participation is not required to use Agent Web Search.

5. Brave

Variable Required Purpose
BRAVE_SEARCH_API_KEY Yes Brave Web Search API credential

Add brave to AGENT_WEB_SEARCH_PROVIDERS after providing the key.

6. Gemini

Variable Required Purpose
GEMINI_API_KEY Yes Google AI API credential
AGENT_WEB_SEARCH_GEMINI_MODELS No Comma/newline-separated Gemini model IDs

Gemini maps common result and time controls into best-effort prompt constraints. One configured model stays fixed; multiple models are selected round-robin for successive requests.

7. Grok

Variable Required Purpose
XAI_API_KEY Yes xAI API credential
AGENT_WEB_SEARCH_GROK_MODELS No Comma/newline-separated Grok model IDs

One configured model stays fixed; multiple models are selected round-robin for successive requests.

When Grok is enabled, the public tool schema adds grok_search_mode:

  • web_search searches the web.
  • x_search searches X with native date filters when available.
  • both exposes both server-side tools in one request and lets Grok choose; it does not issue two independent model requests.

8. Perplexity

This provider uses Perplexity's native structured Search API. It returns result rows rather than a Sonar-generated prose answer; OpenRouter compatibility is intentionally outside this provider's scope.

Variable Required Purpose
PERPLEXITY_API_KEY Yes Perplexity Search API credential

Add perplexity to AGENT_WEB_SEARCH_PROVIDERS after providing the key.

9. Tavily

Variable Required Purpose
TAVILY_API_KEY Yes Tavily Search API credential

Add tavily to AGENT_WEB_SEARCH_PROVIDERS after providing the key.

10. You.com

You.com returns unified web and news sections. Agent Web Search merges both, deduplicates URLs, and applies max_results to the combined result list.

Variable Required Purpose
YDC_API_KEY Yes You.com Search API credential

Add you to AGENT_WEB_SEARCH_PROVIDERS after providing the key.

Common search controls

Each provider maps the shared controls to its native API when possible and ignores unsupported controls.

Provider max_results max_keyword time_range
DDGS Native max_results Ignored Native timelimit
Exa Native result count Ignored Native publish date
Parallel Native max_results Ignored Ignored
ARK Native limit Native Prompt constraint
Brave Native count Ignored Native freshness
Gemini Prompt constraint Prompt constraint Prompt constraint
Grok Prompt constraint Prompt constraint Prompt; X Search also uses native dates
Perplexity Native max_results Ignored Native recency filter
Tavily Native max_results Ignored Native time_range
You.com Native count, combined cap Ignored Native freshness

Prompt-based controls are best-effort and are not strict guarantees.

Integrations

Codex CLI

codex mcp add agent-web-search -- agent-web-search-mcp
codex mcp list

Claude Code

claude mcp add agent-web-search -- agent-web-search-mcp

Or add a project .mcp.json:

{
  "mcpServers": {
    "agent-web-search": {
      "command": "agent-web-search-mcp",
      "args": [],
      "env": {
        "AGENT_WEB_SEARCH_PROVIDERS": "ddgs,exa,parallel"
      }
    }
  }
}

OpenCode

{
  "$schema": "https://opencode.ai/config.json",
  "mcp": {
    "agent-web-search": {
      "type": "local",
      "command": ["agent-web-search-mcp"],
      "environment": {
        "AGENT_WEB_SEARCH_PROVIDERS": "ddgs,exa,parallel"
      },
      "enabled": true
    }
  }
}

Hermes

Install the native plugin directly from GitHub:

pip install 'ddgs>=9.0'
hermes plugins install JerryLiu369/agent-web-search --no-enable
hermes plugins enable agent-web-search --allow-tool-override

The plugin intentionally replaces Hermes' built-in web_search tool, so the explicit --allow-tool-override grant is required. Start a new Hermes session after enabling it; restart the gateway when using a messaging channel.

Hermes can also connect through its generic MCP integration instead of the native plugin.

CLI examples

# Use every startup-enabled provider.
agent-web-search "What changed in the latest OpenAI Codex CLI?"

# Limit results and publication time.
agent-web-search "GPU kernel generation papers" --time-range m --max-results 5

# Select a provider subset for this request.
agent-web-search "latest AI news" --provider ark --provider ddgs

Design principles

  • One core, multiple adapters. MCP, Hermes, CLI, and Python use the same search engine and response models.
  • Independent providers. A failed provider does not discard successful providers; all-provider failure is surfaced explicitly.
  • Transparent execution. Responses expose searched and model instead of treating every HTTP 200 as a completed search.
  • No shared secrets. There is no telemetry or shared API-key service.

Development

Using uv keeps the development environment isolated and reproducible:

git clone https://github.com/JerryLiu369/agent-web-search.git
cd agent-web-search
uv venv
uv pip install -e '.[dev]'
uv run pytest -q
uv run ruff check .
Standard venv + pip alternative
python -m venv .venv
# Linux/macOS: source .venv/bin/activate
# Windows PowerShell: .venv\Scripts\Activate.ps1
python -m pip install -e '.[dev]'
pytest -q
ruff check .

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agent_web_search_mcp-0.2.0.tar.gz (49.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agent_web_search_mcp-0.2.0-py3-none-any.whl (36.9 kB view details)

Uploaded Python 3

File details

Details for the file agent_web_search_mcp-0.2.0.tar.gz.

File metadata

  • Download URL: agent_web_search_mcp-0.2.0.tar.gz
  • Upload date:
  • Size: 49.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for agent_web_search_mcp-0.2.0.tar.gz
Algorithm Hash digest
SHA256 6d100e0d32e22c884e757a85d3e929a9e6da422d4be33b1d41d51f562e94a08d
MD5 f5760c6542d74fa143254065b7381188
BLAKE2b-256 3ec8b78f2343fba8471d6ac54db46a69ab9f2522ecac65c53aa958460ea078e4

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_web_search_mcp-0.2.0.tar.gz:

Publisher: publish.yml on JerryLiu369/agent-web-search

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file agent_web_search_mcp-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for agent_web_search_mcp-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ec917eb685d0c3b99af0231e9b9ca6814246362b8a92bc30a6ce9123a8f51aaf
MD5 7a05b5c376fbc532113f123242b37b8c
BLAKE2b-256 0aa4e89d9264addc2bf6e6bdcdb5b92cafebe2139961e494147259901497d717

See more details on using hashes here.

Provenance

The following attestation bundles were made for agent_web_search_mcp-0.2.0-py3-none-any.whl:

Publisher: publish.yml on JerryLiu369/agent-web-search

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.3.0

2 files

This release

0.2.0 This release

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page