The missing link between AI models and the realβworld web: one API that delivers clean, structured data from any site.
The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.
This implementation leverages the Model Context Protocol (MCP) to create a secure, standardized way for AI assistants to interact with web content.
Imagine telling your LLM "Summarise the latest Hacker News discussion about GPTβ7" β and it simply answers.
MCP (MultiβClient Proxy) makes that happen by doing the boring parts for you:
What Oxylabs MCP does | Why it matters to you |
---|---|
Bypasses antiβbot walls with the Oxylabs global proxy network | Keeps you unblocked and anonymous |
Renders JavaScript in headless Chrome | Singleβpage apps, sorted |
Cleans HTML β JSON | Drop straight into vector DBs or prompts |
Optional structured parsers (Google, Amazon, etc.) | Oneβline access to popular targets |
Scrape content from any site
- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
Automatically get AI-ready data
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and etc.
Bypass blocks & geo-restrictions
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
Flexible setup & cross-platform support
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
Built-in error handling and request management
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Oxylabs MCP provides two sets of tools that can be used together or independently:
- universal_scraper: Uses Oxylabs Web Scraper API for general website scraping.
- google_search_scraper: Uses Oxylabs Web Scraper API to extract results from Google Search.
- amazon_search_scraper: Uses Oxylabs Web Scraper API to scrape Amazon search result pages.
- amazon_product_scraper: Uses Oxylabs Web Scraper API to extract data from individual Amazon product pages.
The Oxylabs AI Studio MCP server provides various AI tools for your agents:
- ai_scraper: Scrape content from any URL in JSON or Markdown format with AI-powered data extraction.
- ai_crawler: Based on a prompt, crawls a website and collects data in Markdown or JSON format across multiple pages.
- ai_browser_agent: Given a task, the agent controls a browser to achieve the given objective and returns data in Markdown, JSON, HTML, or screenshot formats.
- ai_search: Search the web for URLs and their contents with AI-powered content extraction.
When you've set up the MCP server with Claude, you can make requests like:
- Could you scrape
https://www.google.com/search?q=ai
page? - Scrape
https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651V
with parse enabled - Scrape
https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0
with parse and render enabled - Use web unblocker with render to scrape
https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c
- Use AI scraper to get top news headlines from
https://news-site.com
in JSON format. - Use AI crawler with prompt "extract all product information" to crawl
https://example-store.com
- Use browser agent with task "log in and extract dashboard data" on
https://complex-app.com
- Use AI search to find 5 "latest AI developments" and return URLs with their content
Before you begin, make sure you have:
- Oxylabs Web Scraper API Account: Obtain your username and password from Oxylabs (1-week free trial available)
- Oxylabs AI Studio API Key (Optional): For AI-powered tools, obtain your API key from Oxylabs AI Studio (separate service)
Via Smithery CLI:
- Node.js (v16+)
npx
command-line tool
Via uv:
uv
package manager β install it using this guide
- Python 3.12+
uv
package manager β install it using this guide
The Oxylabs MCP Universal Scraper accepts these parameters:
Parameter | Description | Values |
---|---|---|
url |
The URL to scrape | Any valid URL |
render |
Use headless browser rendering | html or None |
geo_location |
Sets the proxy's geo location to retrieve data. | Brasil , Canada , etc. |
user_agent_type |
Device type and browser | desktop , tablet , etc. |
output_format |
The format of the output | links , md , html |
smithery
- Go to https://smithery.ai/server/@oxylabs/oxylabs-mcp
- Login with GitHub
- Find the Install section
- Follow the instructions to generate the config
Auto install with Smithery CLI
# example for Claude Desktop
npx -y @smithery/cli@latest install @upstash/context7-mcp --client claude --key <smithery_key>
uvx
- Install the uv
# macOS and Linux
curl -LsSf https://astral.sh/uv/install.sh | sh
# Windows
powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
- Use the following config
{
"mcpServers": {
"oxylabs": {
"command": "uvx",
"args": ["oxylabs-mcp"],
"env": {
"OXYLABS_USERNAME": "OXYLABS_USERNAME",
"OXYLABS_PASSWORD": "OXYLABS_PASSWORD",
"OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY"
}
}
}
}
uv
- Install the uvx
# macOS and Linux
curl -LsSf https://astral.sh/uv/install.sh | sh
# Windows
powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
- Use the following config
{
"mcpServers": {
"oxylabs": {
"command": "uv",
"args": [
"--directory",
"/<Absolute-path-to-folder>/oxylabs-mcp",
"run",
"oxylabs-mcp"
],
"env": {
"OXYLABS_USERNAME": "OXYLABS_USERNAME",
"OXYLABS_PASSWORD": "OXYLABS_PASSWORD",
"OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY"
}
}
}
}
Navigate to Claude β Settings β Developer β Edit Config and add one of the configurations above to the claude_desktop_config.json
file.
Navigate to Cursor β Settings β Cursor Settings β MCP. Click Add new global MCP server and add one of the configurations above.
Oxylabs MCP server supports the following environment variables
Name | Description | Default |
---|---|---|
OXYLABS_USERNAME |
Your Oxylabs Web Scraper API username | |
OXYLABS_PASSWORD |
Your Oxylabs Web Scraper API password | |
OXYLABS_AI_STUDIO_API_KEY |
Your Oxylabs AI Studio API key | |
LOG_LEVEL |
Log level for the logs returned to the client | INFO |
*At least one set of credentials (Web Scraper API or AI Studio) is required to use the MCP server.
The Oxylabs MCP server supports two independent services:
- Oxylabs Web Scraper API: Requires
OXYLABS_USERNAME
andOXYLABS_PASSWORD
- Oxylabs AI Studio: Requires
OXYLABS_AI_STUDIO_API_KEY
You can use either service independently or both together. The server will automatically detect which credentials are available and enable the corresponding tools.
Server provides additional information about the tool calls in notification/message
events
{
"method": "notifications/message",
"params": {
"level": "info",
"data": "Create job with params: {\"url\": \"https://ip.oxylabs.io\"}"
}
}
{
"method": "notifications/message",
"params": {
"level": "info",
"data": "Job info: job_id=7333113830223918081 job_status=done"
}
}
{
"method": "notifications/message",
"params": {
"level": "error",
"data": "Error: request to Oxylabs API failed"
}
}
Distributed under the MIT License β see LICENSE for details.
Established in 2015, Oxylabs is a market-leading web intelligence collection platform, driven by the highest business, ethics, and compliance standards, enabling companies worldwide to unlock data-driven insights.