PluginBench
MCP Server
Maintained
MIT

io.github.harshitAgr/codabench-mcp MCP Server

io.github.harshitAgr/codabench-mcp

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the io.github.harshitAgr/codabench-mcp MCP server?

MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.

How to install io.github.harshitAgr/codabench-mcp

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • CODABENCH_API_TOKEN
    required
    secret

    DRF token for Codabench. Obtain via https://www.codabench.org/api/docs/ > api-token-auth > Try it out.

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "codabench-mcp": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "<YOUR_CODABENCH_API_TOKEN>"
      }
    }
  }
}

Related MCP servers

Pre-computed astrology YAML via Swiss Ephemeris. Calculation is code, interpretation is AI.

0
Python
AGPL-3.0
View repository →

AI-powered forex and crypto trading analysis with real-time data across 127+ instruments.

REretriEVAL logo

retriEVAL

Active

LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.

0
HTML
Apache-2.0
View repository →

Run and manage H Company's Computer-Use Agents from any MCP client with browser automation and custom tools.

33
Python
MIT
View repository →

Indexed C/C++ code navigation for AI agents — GNU Global (gtags) lookups over MCP, not grep scans.

1
Python
MIT
View repository →

Reddit posts, comments, search, users & subreddits as JSON via Apify. No Reddit API key. $2/1k

0
JavaScript
View repository →