Skip to main content

WebQuest MCP Logo

WebQuest MCP

WebQuest MCP is a Model Context Protocol (MCP) server that exposes powerful web search and scraping tools to AI agents and MCP-compatible clients.

For available scrapers and browsers, see the WebQuest documentation.

Installation

Installing using pip:

pip install webquest-mcp

Installing using uv:

uv add webquest-mcp

Usage

Starting the server

To start the WebQuest MCP server, run:

webquest-mcp serve

The server reads its configuration from environment variables (or a .env file loaded automatically). Available settings:

  • OPENAI_API_KEY (required): OpenAI API key for scrapers.
  • HYPERBROWSER_API_KEY (required): Hyperbrowser API key.
  • WEBQUEST_MCP_AUTH_SECRET (optional): JWT secret to enable authenticated requests. Leave unset to disable auth.
  • WEBQUEST_MCP_AUTH_AUDIENCE (optional, default webquest-mcp): JWT audience to validate when auth is enabled.
  • WEBQUEST_MCP_TRANSPORT (optional, default stdio): MCP transport. Supported values: stdio, sse, streamable-http.
  • WEBQUEST_MCP_HOST (optional, default localhost): Host to bind when the transport is HTTP-based.
  • WEBQUEST_MCP_PORT (optional, default 8000): Port to use when the transport is HTTP-based.

Example .env:

OPENAI_API_KEY=your_openai_api_key
HYPERBROWSER_API_KEY=your_hyperbrowser_api_key
WEBQUEST_MCP_AUTH_SECRET=your_jwt_secret_key
WEBQUEST_MCP_AUTH_AUDIENCE=webquest-mcp
WEBQUEST_MCP_TRANSPORT=streamable-http
WEBQUEST_MCP_HOST=localhost
WEBQUEST_MCP_PORT=8000

Token generation

To generate an authentication token for the MCP client, set the required environment variables and run the generator.

The token generator uses the same WEBQUEST_MCP_* prefix as the server.

Required settings:

  • WEBQUEST_MCP_AUTH_SECRET: JWT secret used by the server.
  • WEBQUEST_MCP_AUTH_SUBJECT: Identifier for the client receiving the token.

Optional settings:

  • WEBQUEST_MCP_AUTH_AUDIENCE (default webquest-mcp)
  • WEBQUEST_MCP_AUTH_EXPIRATION_DAYS (default 365)

Example .env:

WEBQUEST_MCP_AUTH_SECRET=your-secret-key
WEBQUEST_MCP_AUTH_SUBJECT=client-name
WEBQUEST_MCP_AUTH_AUDIENCE=webquest-mcp
WEBQUEST_MCP_AUTH_EXPIRATION_DAYS=365

Run the generator:

webquest-mcp token

Docker

Run the published image:

docker run --rm -p 8000:8000 --env-file .env \
  -e WEBQUEST_MCP_HOST=0.0.0.0 \
  mustafametesengul/webquest-mcp serve

Disclaimer

This tool is for educational and research purposes only. The developers of WebQuest MCP are not responsible for any misuse of this tool. Scraping websites may violate their Terms of Service. Users are solely responsible for ensuring their activities comply with all applicable laws and website policies.

Metadata

Release files for webquest-mcp 0.16.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for webquest-mcp 0.16.0
File Size Uploaded Provenance
webquest_mcp-0.16.0.tar.gz 4.0 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for webquest-mcp 0.16.0
File Interpreter ABI Platform
webquest_mcp-0.16.0-py3-none-any.whl Python 3 none any Details

Total release size: 9.9 kB

Release files / webquest_mcp-0.16.0.tar.gz

Download URL webquest_mcp-0.16.0.tar.gz
Size 4.0 kB
Tags Source
SHA-256 checksum
How to use checksums
4a5e262b71f05b475cb66d93128d6db0db1d987219fd4b9ca74219970bf6f264
BLAKE2b-256 checksum
How to use checksums
13e35b1f34704b449eae1dfcae17b0c6a6c8dabb8dab317205a982051937a548
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.9.1

Release files / webquest_mcp-0.16.0-py3-none-any.whl

Download URL webquest_mcp-0.16.0-py3-none-any.whl
Size 6.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
65539faefb3c44609d50b944f69aeafca86de89461f29e0c4a1969a6aad6c7a2
BLAKE2b-256 checksum
How to use checksums
ab259a42925bc56ddec397b5a9062787b977b4c8c32721a1ec8d9c4a49efa7a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.9.1

Security for webquest-mcp 0.16.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page