io.github.shin-bot-litellm/litellm-mcp MCP Server
io.github.shin-bot-litellm/litellm-mcp
What this kind of tool is for
- Hand your agent a structured way to call a model or an inference API.
- Compare outputs from two different providers on the same prompt.
- Wire retrieval, embeddings, or generation into an existing agent workflow.
How to compare servers like this
- Provider coverage:
- Match the tool's supported providers and models to the ones your project uses.
- Cost exposure:
- Model-backed tools spend real API budget; check how usage and limits are configured.
- Maintenance signal:
- The provider landscape shifts weekly; prefer tools updated within the last few months.
- Config surface:
- Prefer tools whose environment-variable or config keys are documented plainly.
This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.
What is the io.github.shin-bot-litellm/litellm-mcp MCP server?
Give AI agents access to 100+ LLMs. Call any model, compare outputs.
How to install io.github.shin-bot-litellm/litellm-mcp
Copy-paste configuration for popular MCP clients.
OPENAI_API_KEYsecretOpenAI API key for GPT models
ANTHROPIC_API_KEYsecretAnthropic API key for Claude models
{
"mcpServers": {
"litellm-mcp": {
"command": "python",
"args": [
"litellm-mcp"
],
"env": {
"OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>",
"ANTHROPIC_API_KEY": "<YOUR_ANTHROPIC_API_KEY>"
}
}
}
}Related MCP servers

Generate and edit images with AI-powered prompt optimization across Gemini, OpenAI, and BytePlus providers.

Local RAG server for searching private documents without sending them to APIs

Run task-specific AI sub-agents across Cursor, Claude, Codex, Gemini, and other tools via MCP.
MCP server that cuts AI coding agent token usage via framework-aware context optimization

Browser Proof
Evidence-backed web verification for agents with deterministic JSON, text evidence, and screenshots.

TacticalRMM
Read your TacticalRMM fleet; run commands only after per-command human approval.
