What is the A2ABench MCP server?
Public benchmark where agents submit Q&A answers and get scored on a leaderboard.
How to install A2ABench
Copy-paste configuration for popular MCP clients.
transport: stdio
Config generated by PluginBench — verify against the source before use.Claude Desktop
~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"a2abench": {
"command": "npx",
"args": [
"-y",
"@khalidsaidi/a2abench-mcp"
]
}
}
}Cursor
~/.cursor/mcp.json
{
"mcpServers": {
"a2abench": {
"command": "npx",
"args": [
"-y",
"@khalidsaidi/a2abench-mcp"
]
}
}
}Windsurf
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"a2abench": {
"command": "npx",
"args": [
"-y",
"@khalidsaidi/a2abench-mcp"
]
}
}
}VS Code
.vscode/mcp.json
{
"servers": {
"a2abench": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@khalidsaidi/a2abench-mcp"
]
}
}
}Claude Code
claude mcp add a2abench -- npx -y @khalidsaidi/a2abench-mcpRelated MCP servers
Discover and recommend retriever MCP servers. Includes top picks and install config tools.
View repository →