Skip to main content

Oxylabs MCP server

Project description

Oxylabs + MCP

Oxylabs MCP Server

The missing link between AI models and the real‑world web: one API that delivers clean, structured data from any site.


📖 Overview

The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.

This implementation leverages the Model Context Protocol (MCP) to create a secure, standardized way for AI assistants to interact with web content.


Why Oxylabs MCP?  🕸️ ➜ 📦 ➜ 🤖

Imagine telling your LLM "Summarise the latest Hacker News discussion about GPT‑7" – and it simply answers.
MCP (Multi‑Client Proxy) makes that happen by doing the boring parts for you:

What Oxylabs MCP does Why it matters to you
Bypasses anti‑bot walls with the Oxylabs global proxy network Keeps you unblocked and anonymous
Renders JavaScript in headless Chrome Single‑page apps, sorted
Cleans HTML → JSON Drop straight into vector DBs or prompts
Optional structured parsers (Google, Amazon, etc.) One‑line access to popular targets

✨ Key Features

Scrape content from any site
  • Extract data from any URL, including complex single-page applications
  • Fully render dynamic websites using headless browser support
  • Choose full JavaScript rendering, HTML-only, or none
  • Emulate Mobile and Desktop viewports for realistic rendering
Automatically get AI-ready data
  • Automatically clean and convert HTML to Markdown for improved readability
  • Use automated parsers for popular targets like Google, Amazon, and etc.
Bypass blocks & geo-restrictions
  • Bypass sophisticated bot protection systems with high success rate
  • Reliably scrape even the most complex websites
  • Get automatically rotating IPs from a proxy pool covering 195+ countries
Flexible setup & cross-platform support
  • Set rendering and parsing options if needed
  • Feed data directly into AI models or analytics tools
  • Works on macOS, Windows, and Linux
Built-in error handling and request management
  • Comprehensive error handling and reporting
  • Smart rate limiting and request management

💡 Example Queries

When you've set up the MCP server with Claude, you can make requests like:

  • Could you scrape https://www.google.com/search?q=ai page?
  • Scrape https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651V with parse enabled
  • Scrape https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0 with parse and render enabled
  • Use web unblocker with render to scrape https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c

✅ Prerequisites

Before you begin, make sure you have:

  • Oxylabs Account: Obtain your username and password from Oxylabs (1-week free trial available)

Basic Usage

Via Smithery CLI:

  • Node.js (v16+)
  • npx command-line tool

Via uv:

  • uv package manager – install it using this guide

Local/Dev Setup

  • Python 3.12+
  • uv package manager – install it using this guide

🧩 API Parameters

The Oxylabs MCP Universal Scraper accepts these parameters:

Parameter Description Values
url The URL to scrape Any valid URL
render Use headless browser rendering html or None
geo_location Sets the proxy's geo location to retrieve data. Brasil, Canada, etc.
user_agent_type Device type and browser desktop, tablet, etc.
output_format The format of the output links, md, html

🔧 Configuration

uvx client config
{
  "mcpServers": {
    "oxylabs_scraper_uvx": {
      "command": "uvx",
      "args": ["oxylabs-mcp"],
      "env": {
        "OXYLABS_USERNAME": "YOUR_USERNAME",
        "OXYLABS_PASSWORD": "YOUR_PASSWORD"
      }
    }
  }
}
npx client config
{
  "mcpServers": {
    "oxylabs-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli@latest",
        "run",
        "@oxylabs/oxylabs-mcp",
        "--config",
        "\"{\\\"oxylabsUsername\\\":\\\"OXYLABS_USERNAME\\\",\\\"oxylabsPassword\\\":\\\"OXYLABS_PASSWORD\\\"}\""
      ]
    }
  }
}
uv client config
{
  "mcpServers": {
    "oxylabs_scraper": {
      "command": "uv",
      "args": [
        "--directory",
        "/<Absolute-path-to-folder>/oxylabs-mcp",
        "run",
        "oxylabs-mcp"
      ],
      "env": {
        "OXYLABS_USERNAME": "OXYLABS_USERNAME",
        "OXYLABS_PASSWORD": "OXYLABS_PASSWORD"
      }
    }
  }
}

Manual Setup with Claude Desktop

Navigate to Claude → Settings → Developer → Edit Config and add one of the configurations above to the claude_desktop_config.json file.

Manual Setup with Cursor AI

Navigate to Cursor → Settings → Cursor Settings → MCP. Click Add new global MCP server and add one of the configurations above.


🛠️ Technical Details

This server provides two main tools:

  1. universal_scraper: Uses Oxylabs Web Scraper API for general website scraping
  2. google_search_scraper: Uses Oxylabs Web Scraper API to extract results from Google Search
  3. amazon_search_scraper: Uses Oxylabs Web Scraper API to scrape Amazon search result pages
  4. amazon_product_scraper: Uses Oxylabs Web Scraper API to extract data from individual Amazon product pages

🛡️ License

Distributed under the MIT License – see LICENSE for details.


About Oxylabs

Established in 2015, Oxylabs is a market-leading web intelligence collection platform, driven by the highest business, ethics, and compliance standards, enabling companies worldwide to unlock data-driven insights.

image

Made with ☕ by Oxylabs. Feel free to give us a ⭐ if MCP saved you a weekend.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

oxylabs_mcp-0.2.2.tar.gz (60.7 kB view details)

Uploaded Source

Built Distribution

oxylabs_mcp-0.2.2-py3-none-any.whl (12.4 kB view details)

Uploaded Python 3

File details

Details for the file oxylabs_mcp-0.2.2.tar.gz.

File metadata

  • Download URL: oxylabs_mcp-0.2.2.tar.gz
  • Upload date:
  • Size: 60.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for oxylabs_mcp-0.2.2.tar.gz
Algorithm Hash digest
SHA256 69efd370e095dd1b4cd9690588209f611b29339ac25509f5248a6f5352229b64
MD5 a1d718b6680b58550be0d780b52561da
BLAKE2b-256 12a01a0a002644c833cc7c3a03e6773f7cbeb6bbab972ebc7e0377a905472e1c

See more details on using hashes here.

File details

Details for the file oxylabs_mcp-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: oxylabs_mcp-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 12.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for oxylabs_mcp-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 05aa945f38eab499bc35a604a5e445baa541d667e4cf20c389572bf722e9e2f4
MD5 dc59da9f58fd09e27cd1c2e9e1133e42
BLAKE2b-256 d3a282e7fdaec5eb4629c9cec820e36d0a1fa1c29d6abd5a6700b4192b444e40

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page