MCP Server

io.github.ryuamarines/robots-txt-checker MCP Server

io.github.ryuamarines/robots-txt-checker

What is the io.github.ryuamarines/robots-txt-checker MCP server?

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Copy-paste configuration for popular MCP clients.

transport: http

Config generated by PluginBench — verify against the source before use.

~/.cursor/mcp.json

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
    }
  }
}

Converts text titles into URL-safe slugs and flags duplicates. x402 payment required (testnet USDC).

Normalizes and deduplicates a list of URLs. x402 payment required (testnet USDC, Base Sepolia).

Checks current App Store version by bundle ID. x402 payment required (testnet USDC).

Extracts emails from texts. x402 payment required (testnet USDC).

Maintained

MCP server for generating REST API boilerplate and Express endpoints.

JavaScript

Maintained

MCP server for API testing: HTTP requests, cURL generation, health checks.

JavaScript