Web Intelligence MCP Server
Transform your AI applications with advanced web browsing capabilities. This Model Context Protocol (MCP) server empowers AI systems to intelligently navigate, extract, and analyze web content with precision and reliability.
Overview
The Web Intelligence MCP server bridges the gap between AI systems and web content, enabling sophisticated web browsing capabilities through a robust, production-ready API. By leveraging the power of BeautifulSoup4 and modern async processing, it provides AI applications with the ability to understand and extract structured information from any webpage.
Key Features
The server provides enterprise-grade capabilities for web content processing:
- Intelligent content extraction with customizable CSS selectors
- High-performance asynchronous processing
- Comprehensive metadata capture including titles, links, and structured content
- Robust error handling and timeout management
- Production-ready security features
- Cross-platform compatibility
Integration with Claude and AI Applications
Seamlessly integrate web browsing capabilities into your AI workflows by adding this configuration to your claude_desktop_config.json:
{
"mcpServers": {
"web-intelligence": {
"module": "web-browser-mcp",
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}
Enterprise-Ready Features
Our implementation focuses on reliability and security:
- Configurable timeout and retry mechanisms
- Comprehensive error handling
- Rate limiting and resource protection
- Detailed logging and monitoring capabilities
- Production-grade async processing
- Cross-origin request security
API Example
Extract structured content from web pages with precision:
response = requests.post(
"http://localhost:8000/parse",
json={
"url": "https://example.com",
"selectors": {
"article_content": "article.main-content",
"headlines": "h1.headline",
"metadata": ".meta-tags"
}
}
)
structured_content = response.json()
Development and Testing
We maintain high standards for code quality and testing:
# Set up development environment
uv venv
source .venv/bin/activate
uv pip install -e ".[test]"
# Run comprehensive test suite
python -m pytest
Security Considerations
The server implements industry-standard security practices:
- Input validation and sanitization
- Secure request handling
- Timeout controls
- Rate limiting
- Error handling without information exposure
Production Deployment
Deploy with confidence using our production-ready configuration:
python -m mcp_web_browser.cli --workers 4 --log-level warning
Contributing
We welcome contributions that enhance the server's capabilities. Please review our contributing guidelines and code of conduct.
License
This project is licensed under the MIT License, providing flexibility for both personal and commercial use.
Empower your AI applications with intelligent web browsing capabilities. Start integrating today.
Metadata
Release files for web-browser-mcp 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| web_browser_mcp-0.1.1.tar.gz | 6.5 kB | Without provenance | Details for web_browser_mcp-0.1.1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| web_browser_mcp-0.1.1-py3-none-any.whl | Python 3 | none | any | Details for web_browser_mcp-0.1.1-py3-none-any.whl |
Total release size: 13.1 kB
Release files / web_browser_mcp-0.1.1.tar.gz
| Download URL | web_browser_mcp-0.1.1.tar.gz |
|---|---|
| Size | 6.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
49723ab06fa06bebe14b9a425451c122b6f946e008e104ac92cf09bf3e5e3869
|
|
BLAKE2b-256 checksum How to use checksums |
526bae8939c9410972c3c08dbf55aa8cc58427207732cf2bdc88a3363956253d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.4
|
Release files / web_browser_mcp-0.1.1-py3-none-any.whl
| Download URL | web_browser_mcp-0.1.1-py3-none-any.whl |
|---|---|
| Size | 6.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
778b2b94590727ea275b4836bf71a1e43a3924c5f5db2a380d32d9e8b00833b6
|
|
BLAKE2b-256 checksum How to use checksums |
130d1160d071bba5b94048a7bfb6820b9a42dd4004badbde181f885769307617
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.5.4
|
Security for web-browser-mcp 0.1.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.