Open-source MCP Server for web search, extract, crawl, academic research, and library docs with embedded SearXNG
Project description
WET - Web Extended Toolkit MCP Server
mcp-name: io.github.n24q02m/wet-mcp
Open-source MCP Server for web search, content extraction, library docs & multimodal analysis.
Features
- Web Search -- Embedded SearXNG metasearch (Google, Bing, DuckDuckGo, Brave) with filters, semantic reranking, query expansion, and snippet enrichment
- Academic Research -- Search Google Scholar, Semantic Scholar, arXiv, PubMed, CrossRef, BASE
- Library Docs -- Auto-discover and index documentation with FTS5 hybrid search, HyDE-enhanced retrieval, and version-specific docs
- Content Extract -- Clean content extraction (Markdown/Text), structured data extraction (LLM + JSON Schema), batch processing (up to 50 URLs), deep crawling, site mapping
- Local File Conversion -- Convert PDF, DOCX, XLSX, CSV, HTML, EPUB, PPTX to Markdown
- Media -- List, download, and analyze images, videos, audio files
- Anti-bot -- Stealth mode bypasses Cloudflare, Medium, LinkedIn, Twitter
- Zero Config -- Built-in local Qwen3 embedding + reranking, no API keys needed. Optional cloud providers (Jina AI, Gemini, OpenAI, Cohere)
- Sync -- Cross-machine sync of indexed docs via Google Drive (OAuth Device Code, no browser redirect)
Setup
With AI Agent -- copy and send this to your AI agent:
Please set up wet-mcp for me. Follow this guide: https://raw.githubusercontent.com/n24q02m/wet-mcp/main/docs/setup-with-agent.md
Manual Setup -- follow docs/setup-manual.md
Tools
| Tool | Actions | Description |
|---|---|---|
search |
search, research, docs, similar |
Web search (with filters, reranking, expand/enrich), academic research, library docs (HyDE), find similar |
extract |
extract, batch, crawl, map, convert, extract_structured |
Content extraction, batch processing (up to 50 URLs), deep crawling, site mapping, local file conversion, structured data extraction (JSON Schema) |
media |
list, download, analyze |
Media discovery, download, and analysis |
config |
status, set, cache_clear, docs_reindex |
Server configuration and cache management |
setup |
open_relay, status, skip, reset, complete, warmup, setup_sync |
Credential setup (browser relay, local-only mode, reset), status check, model warmup, Google Drive sync |
help |
-- | Full documentation for any tool |
Security
- SSRF prevention -- URL validation on crawl targets
- Graceful fallbacks -- Cloud → Local embedding, multi-tier crawling
- Error sanitization -- No credentials in error messages
- File conversion sandboxing -- Optional
CONVERT_ALLOWED_DIRSrestriction
Build from Source
git clone https://github.com/n24q02m/wet-mcp.git
cd wet-mcp
uv sync
uv run wet-mcp
License
MIT -- See LICENSE.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file wet_mcp-2.25.2.tar.gz.
File metadata
- Download URL: wet_mcp-2.25.2.tar.gz
- Upload date:
- Size: 118.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
03f7ef9148377a2eff41365d49f9c20112d466e18bda51124edad8674b8fccd7
|
|
| MD5 |
a01e420f7e77ce7c58038e57dc36059b
|
|
| BLAKE2b-256 |
6b2c338e48d20e4576ba048fc24630fdab76088fddaec25ad0fb46cb51eee77b
|
File details
Details for the file wet_mcp-2.25.2-py3-none-any.whl.
File metadata
- Download URL: wet_mcp-2.25.2-py3-none-any.whl
- Upload date:
- Size: 132.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: uv/0.11.7 {"installer":{"name":"uv","version":"0.11.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a37d0f8088f742d558a2161b35660d426e08c9a9f32e79f96898a7720223b105
|
|
| MD5 |
52ecbca64b3186bf3a096604ce517d48
|
|
| BLAKE2b-256 |
866b321c86d27cf04505d83f1d12faa2ccffdabd3bcf95b3edcf5674a4b39a79
|