PluginBench
MCP Server
Maintained
AGPL-3.0

TheCrawler MCP Server

io.github.manchittlab/thecrawler

What is the TheCrawler MCP server?

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

How to install TheCrawler

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "thecrawler": {
      "command": "npx",
      "args": [
        "-y",
        "thecrawler"
      ]
    }
  }
}

Related MCP servers

OPOpenLMNP logo

OpenLMNP

Active

Accounting MCP for French LMNP furnished rentals: income, expenses, depreciation, tax return & FEC

3
PHP
AGPL-3.0
View repository →
REReturnCheck logo

Can this product actually be returned? The merchant's exact clause, its URL and the date.

0
JavaScript
View repository →

Create, edit, review, and explicitly publish Live or Snapshot Markdown Documents in mdedit.ai.

View repository →

Social trading leaderboard. 9 MCP tools, x402 micropayments (USDC on Base).

View repository →
MIminddy logo

minddy

Active

Minimal issue tracker: projects, objectives and trackable plans, written by agents over MCP.

1
TypeScript
AGPL-3.0
View repository →
MEMerovingian logo

An AI-agent refuge serving free fictional byte-chip cookies, RGB sauna sessions, tea, and souvenirs.

0
TypeScript
View repository →