io.github.RudrenduPaul/agent-eval MCP Server

io.github.RudrenduPaul/agent-eval

Repository Registry

What is the io.github.RudrenduPaul/agent-eval MCP server?

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

How to install io.github.RudrenduPaul/agent-eval

Copy-paste configuration for popular MCP clients.

transport: stdio

Config generated by PluginBench — verify against the source before use.

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "agent-eval": {
      "command": "uvx",
      "args": [
        "agent-regress-cli",
        "--from",
        "agent-regress-cli",
        "agent-regress-mcp"
      ]
    }
  }
}

Related MCP servers

io.github.RudrenduPaul/agent-observability

Active

AI agent observability with deterministic record/replay for debugging agent failures.

Python

Apache-2.0

View repository →

io.github.RudrenduPaul/agenticworkspace

Active

Wraps the AgenticWorkspace CLI as a single generic MCP tool for repo workspace scans.

Python

Apache-2.0

View repository →

io.github.RudrenduPaul/auditreach

Active

BYOK Reddit/YouTube research CLI with a tamper-evident audit log and an MCP server.

Python

Apache-2.0

View repository →

io.github.RudrenduPaul/computeledger

Active

Signs, hash-chains, and verifies compute usage receipts via an MCP server, no issuer trust required.

Python

Apache-2.0

View repository →

io.github.RudrenduPaul/continuityguard

Active

Wraps the ContinuityGuard CLI as a single generic MCP tool for video-clip continuity scans.

Python

Apache-2.0

View repository →

io.github.RudrenduPaul/deskcert

Active

Evaluates whether an AI agent is safe to operate internal web apps via an MCP run_suite tool.

Python

Apache-2.0

View repository →