io.github.Grubbomatic/crawl-readiness MCP Server
io.github.Grubbomatic/crawl-readiness
What this kind of tool is for
- Hand your agent a structured way to call a model or an inference API.
- Compare outputs from two different providers on the same prompt.
- Wire retrieval, embeddings, or generation into an existing agent workflow.
How to compare servers like this
- Provider coverage:
- Match the tool's supported providers and models to the ones your project uses.
- Cost exposure:
- Model-backed tools spend real API budget; check how usage and limits are configured.
- Maintenance signal:
- The provider landscape shifts weekly; prefer tools updated within the last few months.
- Config surface:
- Prefer tools whose environment-variable or config keys are documented plainly.
This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.
What is the io.github.Grubbomatic/crawl-readiness MCP server?
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
How to install io.github.Grubbomatic/crawl-readiness
Copy-paste configuration for popular MCP clients.
CRAWL_READINESS_API_KEYsecretFree API key from https://www.crawlreadiness.com/dashboard. The four audit tools work without it; the three generators and get_monitor_trend need it.
CRAWL_READINESS_API_BASEOverride the API base URL. Only useful for testing against a preview deployment; defaults to https://www.crawlreadiness.com.
{
"mcpServers": {
"crawl-readiness": {
"command": "npx",
"args": [
"-y",
"crawl-readiness-mcp"
],
"env": {
"CRAWL_READINESS_API_KEY": "<YOUR_CRAWL_READINESS_API_KEY>",
"CRAWL_READINESS_API_BASE": "<YOUR_CRAWL_READINESS_API_BASE>"
}
}
}
}Related MCP servers

Lex
Episodic memory and architectural policy for AI agents. Frames, Atlas, and Policy.

QECTOR Quantum Error Correction
Local quantum error correction tools; decoder output verified against H c = s (mod 2).

GetABrain
Real human judgment as agent tools — ask a question, get a structured human answer back.

WhitePact
AI governance MCP server: trust scoring, guardrails, bias/hallucination detection, compliance.
A simple MCP server example written in TypeScript that provides a multiplication tool.
View repository →Live layered dependency map for bottom-up development, drawn by the agent in a terminal pane.

