PluginBench
MCP Server
Maintained
MIT

AI-First Scraper MCP Server

io.github.yubinkim444/ai-first-scraper-mcp

RepositoryRegistry
How to choose

What this kind of tool is for

  • Let your agent search the web or a document set and cite what it found.
  • Pull structured facts out of pages instead of copy-pasting by hand.
  • Track changes on a topic over days without re-reading everything.

How to compare servers like this

Source coverage:
Check which engines, sites, or document types the tool can actually reach.
Citation behavior:
Prefer tools that return links you can open, not just summarized claims.
Terms of service:
Some sources forbid automated access; make sure the tool stays inside them.
Maintenance signal:
Scrapers break silently when pages change; recent commits are the best proxy.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the AI-First Scraper MCP server?

Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.

How to install AI-First Scraper

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • SCRAPER_URL

    URL of the ai-first-scraper instance to use. Default: https://ai-first-scraper.onrender.com

  • SEARCH_URL

    URL of the ai-first-search instance to use. Default: https://ai-first-search.onrender.com

  • AFS_TIMEOUT

    Upstream HTTP timeout in seconds. Default: 45

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "ai-first-scraper-mcp": {
      "command": "uvx",
      "args": [
        "ai-first-scraper-mcp"
      ],
      "env": {
        "SCRAPER_URL": "<YOUR_SCRAPER_URL>",
        "SEARCH_URL": "<YOUR_SEARCH_URL>",
        "AFS_TIMEOUT": "<YOUR_AFS_TIMEOUT>"
      }
    }
  }
}

Related MCP servers

RERepo Memory logo

Repo Memory

Maintained

Shared, git-tracked working memory for AI agents on the same codebase.

1
Python
MIT
View repository →

Korean public official asset disclosure data (공직자 재산공개) - search and retrieve assets

View repository →
ANAniList logo

AniList

Maintained

Access AniList anime, manga, character, and user data through Claude and other LLM clients.

84
TypeScript
MIT
View repository →

X/Twitter search, profiles, timelines, and Smart Money discovery via XFlux.

0
TypeScript
View repository →

Double-entry bookkeeping MCP server — import bank CSVs, categorize, reconcile, tax reports.

0
TypeScript
MIT
View repository →

Multi-database MCP server for PostgreSQL, MySQL, and ClickHouse

6
Python
MIT
View repository →