MCP Server

io.github.jmshinhwa/robots-txt-ai-crawler-audit MCP Server

io.github.jmshinhwa/robots-txt-ai-crawler-audit

Repository Registry

What is the io.github.jmshinhwa/robots-txt-ai-crawler-audit MCP server?

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

How to install io.github.jmshinhwa/robots-txt-ai-crawler-audit

Copy-paste configuration for popular MCP clients.

transport: stdio

Config generated by PluginBench — verify against the source before use.

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "robots-txt-ai-crawler-audit": {
      "command": "npx",
      "args": [
        "-y",
        "@readystack/robots-txt-ai-crawler-audit",
        "--mcp"
      ]
    }
  }
}

Related MCP servers

io.github.jmshinhwa/romu-hozon-kikan-lint-jp

法定帳簿の保存期間を文書保存期間表で検査 — 労基法109条・安衛則51条・石綿則41条・雇用保険法施行規則143条・健保則34条（20 rules）

View repository →

io.github.jmshinhwa/runtime-eol-deploy-block-audit

Finds the end-of-life runtimes an AI assistant still writes for you — node:20, python3.9, ubuntu-22

View repository →

io.github.jmshinhwa/saft-pt-atcud-lint

14 verificações ao XML SAF-T (PT) antes da entrega à AT: versão 1.04_01, ATCUD, dados do QR code, ha

View repository →

io.github.jmshinhwa/security-headers-csp-lint

Reads security headers and CSP line by line in your config file and names the lines that silently do

View repository →

io.github.jmshinhwa/security-txt-cra-lint

13 rules that decide whether a vulnerability report ever reaches you

View repository →

io.github.jmshinhwa/sepa-pain001-reject-lint

Find the lines your bank will refuse before you send the batch

View repository →