PluginBench
MCP Server
Active
MIT

Commoncrawl MCP Server

io.github.pipeworx-io/commoncrawl

RepositoryRegistry
How to choose

What this kind of tool is for

  • Let your agent search the web or a document set and cite what it found.
  • Pull structured facts out of pages instead of copy-pasting by hand.
  • Track changes on a topic over days without re-reading everything.

How to compare servers like this

Source coverage:
Check which engines, sites, or document types the tool can actually reach.
Citation behavior:
Prefer tools that return links you can open, not just summarized claims.
Terms of service:
Some sources forbid automated access; make sure the tool stays inside them.
Maintenance signal:
Scrapers break silently when pages change; recent commits are the best proxy.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the Commoncrawl MCP server?

Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the…

How to install Commoncrawl

Copy-paste configuration for popular MCP clients.

transport: http
Config generated by PluginBench — verify against the source before use.
~/.cursor/mcp.json
JSON config
{
  "mcpServers": {
    "commoncrawl": {
      "url": "https://gateway.pipeworx.io/commoncrawl/mcp"
    }
  }
}

Related MCP servers

Wikimedia Commons MCP — Action API for files.

0
TypeScript
MIT
View repository →

Companies House MCP — UK statutory company registry (BYO key)

0
TypeScript
MIT
View repository →

EBI Complex Portal MCP.

0
TypeScript
MIT
View repository →
COComtrade logo

Comtrade

Active

Comtrade MCP — UN Comtrade API for international bilateral trade data

0
TypeScript
MIT
View repository →
COConceptnet logo

ConceptNet MCP — open multilingual word/phrase relation graph

0
TypeScript
MIT
View repository →
COConfluence logo

Confluence MCP — wraps the Confluence Cloud REST API v2 (OAuth)

0
TypeScript
MIT
View repository →