AI-First Scraper MCP Server

io.github.yubinkim444/ai-first-scraper-mcp

Repository Registry

What is the AI-First Scraper MCP server?

Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.

How to install AI-First Scraper

Copy-paste configuration for popular MCP clients.

transport: stdio

Config generated by PluginBench — verify against the source before use.

Environment / auth

SCRAPER_URL
URL of the ai-first-scraper instance to use. Default: https://ai-first-scraper.onrender.com
SEARCH_URL
URL of the ai-first-search instance to use. Default: https://ai-first-search.onrender.com
AFS_TIMEOUT
Upstream HTTP timeout in seconds. Default: 45

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "ai-first-scraper-mcp": {
      "command": "uvx",
      "args": [
        "ai-first-scraper-mcp"
      ],
      "env": {
        "SCRAPER_URL": "<YOUR_SCRAPER_URL>",
        "SEARCH_URL": "<YOUR_SEARCH_URL>",
        "AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
      }
    }
  }
}