What is the AI-First Scraper MCP server?
Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.
How to install AI-First Scraper
Copy-paste configuration for popular MCP clients.
transport: stdio
Config generated by PluginBench — verify against the source before use.Environment / auth
SCRAPER_URLURL of the ai-first-scraper instance to use. Default: https://ai-first-scraper.onrender.com
SEARCH_URLURL of the ai-first-search instance to use. Default: https://ai-first-search.onrender.com
AFS_TIMEOUTUpstream HTTP timeout in seconds. Default: 45
Claude Desktop
~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"ai-first-scraper-mcp": {
"command": "uvx",
"args": [
"ai-first-scraper-mcp"
],
"env": {
"SCRAPER_URL": "<YOUR_SCRAPER_URL>",
"SEARCH_URL": "<YOUR_SEARCH_URL>",
"AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
}
}
}
}Cursor
~/.cursor/mcp.json
{
"mcpServers": {
"ai-first-scraper-mcp": {
"command": "uvx",
"args": [
"ai-first-scraper-mcp"
],
"env": {
"SCRAPER_URL": "<YOUR_SCRAPER_URL>",
"SEARCH_URL": "<YOUR_SEARCH_URL>",
"AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
}
}
}
}Windsurf
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"ai-first-scraper-mcp": {
"command": "uvx",
"args": [
"ai-first-scraper-mcp"
],
"env": {
"SCRAPER_URL": "<YOUR_SCRAPER_URL>",
"SEARCH_URL": "<YOUR_SEARCH_URL>",
"AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
}
}
}
}VS Code
.vscode/mcp.json
{
"servers": {
"ai-first-scraper-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"ai-first-scraper-mcp"
],
"env": {
"SCRAPER_URL": "<YOUR_SCRAPER_URL>",
"SEARCH_URL": "<YOUR_SEARCH_URL>",
"AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
}
}
}
}Claude Code
claude mcp add ai-first-scraper-mcp --env SCRAPER_URL=<YOUR_SCRAPER_URL> --env SEARCH_URL=<YOUR_SEARCH_URL> --env AFS_TIMEOUT=<YOUR_AFS_TIMEOUT> -- uvx ai-first-scraper-mcp