MCP Server

io.github.ipezygj/evalgate MCP Server

Name: io.github.ipezygj/evalgate MCP Server
Author: io.github.ipezygj

io.github.ipezygj/evalgate

What is the io.github.ipezygj/evalgate MCP server?

Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).

Copy-paste configuration for popular MCP clients.

transport: stdio

Config generated by PluginBench — verify against the source before use.

Claude Desktop

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "evalgate": {
      "command": "uvx",
      "args": [
        "eval-integrity"
      ]
    }
  }
}

Cursor

~/.cursor/mcp.json

{
  "mcpServers": {
    "evalgate": {
      "command": "uvx",
      "args": [
        "eval-integrity"
      ]
    }
  }
}

Windsurf

~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "evalgate": {
      "command": "uvx",
      "args": [
        "eval-integrity"
      ]
    }
  }
}

VS Code

.vscode/mcp.json

{
  "servers": {
    "evalgate": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "eval-integrity"
      ]
    }
  }
}

Claude Code

claude mcp add evalgate -- uvx eval-integrity

Active

Verify a number before an agent asserts it — evals, backtests (Deflated Sharpe), signed receipts.

Python

MIT

Safety checks an agent runs before it acts: package malware, destructive command, secret leak.