PluginBench
MCP Server

io.github.shin-bot-litellm/litellm-mcp MCP Server

io.github.shin-bot-litellm/litellm-mcp

RepositoryRegistry
How to choose

What this kind of tool is for

  • Hand your agent a structured way to call a model or an inference API.
  • Compare outputs from two different providers on the same prompt.
  • Wire retrieval, embeddings, or generation into an existing agent workflow.

How to compare servers like this

Provider coverage:
Match the tool's supported providers and models to the ones your project uses.
Cost exposure:
Model-backed tools spend real API budget; check how usage and limits are configured.
Maintenance signal:
The provider landscape shifts weekly; prefer tools updated within the last few months.
Config surface:
Prefer tools whose environment-variable or config keys are documented plainly.

This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.

What is the io.github.shin-bot-litellm/litellm-mcp MCP server?

Give AI agents access to 100+ LLMs. Call any model, compare outputs.

How to install io.github.shin-bot-litellm/litellm-mcp

Copy-paste configuration for popular MCP clients.

transport: stdio
Config generated by PluginBench — verify against the source before use.
Environment / auth
  • OPENAI_API_KEY
    secret

    OpenAI API key for GPT models

  • ANTHROPIC_API_KEY
    secret

    Anthropic API key for Claude models

~/Library/Application Support/Claude/claude_desktop_config.json
JSON config
{
  "mcpServers": {
    "litellm-mcp": {
      "command": "python",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>",
        "ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>"
      }
    }
  }
}

Related MCP servers

Generate and edit images with AI-powered prompt optimization across Gemini, OpenAI, and BytePlus providers.

153
TypeScript
MIT
View repository →

Local RAG server for searching private documents without sending them to APIs

369
TypeScript
MIT
View repository →

Run task-specific AI sub-agents across Cursor, Claude, Codex, Gemini, and other tools via MCP.

95
TypeScript
MIT
View repository →

MCP server that cuts AI coding agent token usage via framework-aware context optimization

0
TypeScript
View repository →
BRBrowser Proof logo

Browser Proof

Maintained

Evidence-backed web verification for agents with deterministic JSON, text evidence, and screenshots.

0
View repository →
TATacticalRMM logo

Read your TacticalRMM fleet; run commands only after per-command human approval.

1
Python
AGPL-3.0
View repository →