Ollama / vLLM Bridge MCP Server
io.github.setheerwagen/mcp-ollama-vllm
What this kind of tool is for
- Hand your agent a structured way to call a model or an inference API.
- Compare outputs from two different providers on the same prompt.
- Wire retrieval, embeddings, or generation into an existing agent workflow.
How to compare servers like this
- Provider coverage:
- Match the tool's supported providers and models to the ones your project uses.
- Cost exposure:
- Model-backed tools spend real API budget; check how usage and limits are configured.
- Maintenance signal:
- The provider landscape shifts weekly; prefer tools updated within the last few months.
- Config surface:
- Prefer tools whose environment-variable or config keys are documented plainly.
This page carries your copy-paste config: pick your MCP client in the install section on this page and use the copy button.
What is the Ollama / vLLM Bridge MCP server?
Call your local Ollama or vLLM model over MCP with schema-validated JSON output
How to install Ollama / vLLM Bridge
Copy-paste configuration for popular MCP clients.
LOCAL_BACKENDBackend to use: ollama, vllm or openai
LOCAL_HOSTModel endpoint URL; must be local or on your own network. Required for the openai backend
LOCAL_API_KEYsecretOptional bearer token, openai backend only; sent as a header, never logged
LOCAL_TIMEOUTRead timeout in seconds
LOCAL_EMBED_MODELDefault embedding model
LOCAL_EMBED_PATHOptional, openai backend only: embedding endpoint path
LOCAL_SCHEMA_MODEOptional, openai backend only: auto, response_format or none
{
"mcpServers": {
"mcp-ollama-vllm": {
"command": "uvx",
"args": [
"mcp-ollama-vllm"
],
"env": {
"LOCAL_BACKEND": "<YOUR_LOCAL_BACKEND>",
"LOCAL_HOST": "<YOUR_LOCAL_HOST>",
"LOCAL_API_KEY": "<YOUR_LOCAL_API_KEY>",
"LOCAL_TIMEOUT": "<YOUR_LOCAL_TIMEOUT>",
"LOCAL_EMBED_MODEL": "<YOUR_LOCAL_EMBED_MODEL>",
"LOCAL_EMBED_PATH": "<YOUR_LOCAL_EMBED_PATH>",
"LOCAL_SCHEMA_MODE": "<YOUR_LOCAL_SCHEMA_MODE>"
}
}
}
}Related MCP servers

Model Manager
Manage your local model machine over MCP: state, model pull/remove, service switch, LoRA training

Local-first RAG MCP server: hybrid search over a folder of your own documents

Access 100+ curated AI agent skills from Anthropic, Vercel, Trail of Bits, Hugging Face & more
Agent-first data marketplace — AI agents search, purchase, and sell datasets via MCP.
View repository →Work your Luca workspace from any MCP client: 183 API tools + 15 task tools for leads and calls.

Campus Jobs Radar 校招雷达
China state-owned enterprise campus recruitment: search jobs, deadlines, official source links.
