World Model MCP MCP Server
io.github.putervision/world-model-mcp
Persistent 3D/2D spatial world model for AI agents with entity tracking, collision simulation, and durable memory.
What is the World Model MCP MCP server?
The World Model MCP server is a zero-infrastructure MCP server that maintains a persistent 3D/2D spatial world model for AI agents, enabling durable entity tracking, object permanence with confidence decay, and collision-aware movement simulation. It bridges perception and reasoning by providing deterministic spatial indexing, topological relationship graphs, and Playwright game automation capabilities.
World Model MCP gives AI agents a persistent, queryable spatial memory of their environment. It tracks entities in 3D space with confidence decay, simulates movement with AABB collision avoidance, computes expected view frustums, and integrates with vision perception and task planning systems. All data stays local in SQLite with full audit trails and cryptographic evidence bundling.
How to install World Model MCP
Copy-paste configuration for popular MCP clients.
Tools & capabilities
Tools this server exposes to the agent.
update_entity— Create, read, update, or delete entities with 3D bounding boxes, properties, and confidence scores.query_entities— Search entities by name (FTS5), proximity radius, status, tags, and retrieve history.set_relation— Define topological relationships between entities: on, inside, near, contains.get_spatial_map— Export spatial state as JSON, GeoJSON, glTF 2.0, OBJ, or compact observer-relative slices.simulate_movement— Predict entity displacement, detect AABB collisions, and compute obstacle-avoiding waypoints.ingest_observation— Integrate vision detections, perform Euclidean re-identification, and reconcile with persistent memory.get_expected_view— Compute observer pose, horizontal FOV cone, and ray-AABB occlusion from a viewpoint.link_to_goal— Associate entities and regions with State Memory tasks and extract spatial context slices.record_outcome— Log execution results, position shifts, property changes, and entity destruction.manage_spatial_spec— Register and verify physical clearance and containment contracts with live scoring.create_evidence_pack— Generate cryptographic SHA-256 evidence bundles linking spatial proofs to task nodes.use_spatial_blackboard— Coordinate multi-agent actions via topic-based board with mutex locks and intent conflict alerts.manage_snapshot— Create checkpoints, diff snapshots, and perform time-travel undo/rollback.wait_for_spatial_state— Asynchronously poll for target spatial conditions before proceeding.generate_game_inputs— Produce Playwright WASD/Arrow keyboard hold sequences and 3D↔2D screen ray projections.
Use cases
- Build autonomous agents that navigate 3D game environments with collision avoidance and waypoint routing.
- Maintain persistent spatial memory of detected objects with confidence decay when they leave view.
- Coordinate multi-agent actions using spatial blackboards with mutex locks and intent conflict detection.
- Generate timed keyboard inputs for Playwright game automation with accurate 3D-to-2D screen projections.
- Verify spatial contracts (clearance, containment) and create cryptographic evidence bundles for task auditing.
World Model MCP MCP server FAQ
It's an MCP server that maintains a persistent 3D/2D spatial world model for AI agents. It tracks entities with durable memory, simulates movement with collision avoidance, and integrates perception and task planning via deterministic SQLite queries and topological relationship graphs.
Yes, World Model MCP is open-source under the MIT License and free to use.
Install globally via npm (npm install -g @putervision/world-model-mcp), then run world-model-mcp init in your project directory. This auto-scaffolds MCP configs for Cursor, Claude, VS Code, and Windsurf.
No. World Model MCP is 100% local—all spatial data, entities, and history stay in .world-model-mcp/ in your workspace. No telemetry or external API calls.
Node.js >= 18.18.0 is required. The server uses SQLite (included) and runs deterministically without LLM in the loop for spatial indexing.
Yes. It integrates with Playwright to generate timed WASD/Arrow keyboard sequences and compute 3D↔2D screen ray projections for game automation.
README (reference)
Source of truth, from the repository.
@putervision/world-model-mcp
@putervision/world-model-mcp is a zero-infrastructure, deterministic Model Context Protocol (MCP) server that maintains a persistent 3D/2D spatial world model for AI agents. It bridges perception (@putervision/vision-memory-mcp) and reasoning/action (@putervision/state-memory-mcp) with durable entity tracking, object permanence with confidence decay, movement simulation with AABB collision avoidance, expected view frustum projection, and Playwright 3D game automation.
🌐 Official Documentation & Website: putervision.com
⚡ Quick Start & Installation
Prerequisites: Node.js >= 18.18.0
# 1. Install globally
npm install -g @putervision/world-model-mcp
# 2. Navigate to your project directory
cd your-project
# 3. Initialize world-model-mcp
# Creates .world-model-mcp/, updates .gitignore, registers project,
# and scaffolds IDE instructions and MCP configs for Cursor, Claude, VS Code, Windsurf, etc.
world-model-mcp init
# Done! Restart your IDE or Agent Manager to activate.
Alternative Options
# Run directly via binary (after global install)
world-model-mcp run
# Launch interactive 3D WebGL Scene Visualizer
world-model-mcp view
# Display database metrics and permanence confidence stats
world-model-mcp stats
🌟 Key Highlights
- 🌐 Deterministic 3D/2D Spatial Memory & Compact Slices: Zero LLM in the loop for spatial indexing; deterministic SQLite WAL queries with FTS5 search, 3D Euclidean proximity radius lookups, and sub-1KB observer-relative compact slices ($K \le 16$ nearest entities) for System 1 fast path evaluation.
- ⚡ 15 Production-Grade Consolidated MCP Tools: Full CRUD, topological spatial graphs (
on,inside,contains,near), ray-AABB occlusion frustum culling, waypoint navigation, and time-travel rollback. - ⏳ Object Permanence & Decay: Entities remain in persistent memory even when out of view, with configurable exponential confidence decay ($C = C_0 \cdot e^{-\lambda t}$) and status lifecycles (
active→hidden→lost). - 🚀 Collision & Movement Simulation: Predicts entity displacement trajectories, detects AABB obstacle collisions, and computes obstacle-avoiding navigation waypoints before actions execute.
- 🎮 Playwright Game Automation: Generates timed WASD / Arrow keyboard hold sequences (
KeyW for 450ms,ArrowLeft for 290ms) and 3D↔2D coordinate screen projections. - 🤝 Multi-Agent Spatial Blackboard: Topic-based coordination with TTL, mutex locks, and collision intent alerts across parallel subagents.
- 🛡️ Spatial Spec-Driven Development (Spatial SDD): Physical design contract baseline registration, live verification (clearance, bounds, containment), and cryptographic SHA-256 evidence bundles.
- 🎨 Interactive 3D WebGL Visualizer: Browser-based Three.js 3D viewport rendering active entities, orientation axes, frustum cones, and topological links (
world-model-mcp view). - 🔒 100% Local & Private: All spatial entities, relations, and history stay inside
.world-model-mcp/in your workspace.
🛠️ MCP Tool Suite
@putervision/world-model-mcp provides 15 production-grade consolidated MCP tools organized across 5 core workflow domains:
- Spatial Memory & Search:
update_entity(entity CRUD, 3D bounds, properties, confidence),query_entities(FTS5 search, proximity radius, status/tags filter, history lookup),set_relation(topological graph links:on,inside,near,contains),get_spatial_map(JSON, GeoJSON, glTF 2.0, OBJ, summary, andformat: "compact_slice"). - Simulation & Vision Integration:
simulate_movement(displacement prediction, AABB collision checks, waypoint routing),ingest_observation(vision detection ingestion, Euclidean re-identification, frustum reconciliation),get_expected_view(observer pose, horizontal FOV cone, ray-AABB occlusion). - Goal & State Integration:
link_to_goal(associate entities/regions with State Memory tasks, extract spatial context slices),record_outcome(record execution results, position shifts, property changes, destruction). - Spatial SDD & Proofs:
manage_spatial_spec(register physical clearance/containment contracts, live verification scoring),create_evidence_pack(cryptographic SHA-256 evidence bundles linking spatial proofs to task nodes). - Multi-Agent, Replay & Automation:
use_spatial_blackboard(topic board, mutex claim/release, intent conflicts),manage_snapshot(checkpoints, snapshot diffing, time-travel undo),wait_for_spatial_state(async polling for target spatial condition),generate_game_inputs(Playwright WASD hold timings, 3D↔2D screen ray projection).
👉 For complete parameter specifications, return schemas, and example payloads, see the API Reference Guide and Database Schema.
🚀 Architecture & Spatial Memory Lifecycle
Perception / Vision Detection
│
▼
┌─────────────────────────────────┐
│ Perception Ingestion & Re-ID │ ──▶ ingest_observation(reconcile: true)
└────────────────┬────────────────┘
│
▼
┌─────────────────────────────────┐
│ Durable Entity & Permanence │ ──▶ update_entity(...)
│ (3D Bounding Boxes, Decay) │ ──▶ set_relation(relation: "on"|"inside")
└────────────────┬────────────────┘
│
▼
┌─────────────────────────────────┐
│ Simulation & Waypoint Routing │ ──▶ simulate_movement(mode: "navigate")
│ (AABB Collision Avoidance) │ ──▶ get_expected_view(fov: 90)
└────────────────┬────────────────┘
│
▼
┌─────────────────────────────────┐
│ Playwright & Action Execution │ ──▶ generate_game_inputs(...)
│ (WASD Sequences, Screen Rays) │ ──▶ record_outcome(action_type: "move")
└────────────────┬────────────────┘
│
▼
┌─────────────────────────────────┐
│ Spatial SDD & Cryptographic │ ──▶ manage_spatial_spec(action: "verify")
│ Evidence Bundling to Tasks │ ──▶ create_evidence_pack(...)
└────────────────┬────────────────┘
│
▼
┌─────────────────────────────────┐
│ Persistent SQLite Engine │ ──▶ .world-model-mcp/world.db (WAL mode)
│ Append-Only History Ledger │ ──▶ SHA-256 Cryptographic Audit Chain
└─────────────────────────────────┘
📚 Documentation Directory
Explore dedicated guides and deep dives in the docs/ directory:
| Guide | Description |
|---|---|
| 🏗️ Architecture & Codebase Distillation | High-signal architectural overview, module inventory, data flows, and design decisions. |
| 💡 Features & Triad Overview | PuterVision Autonomous Triad interaction, 3D WebGL scene visualizer, and evidence packs. |
| 📋 Spatial World Model Concepts | Object Permanence ($C = C_0 \cdot e^{-\lambda t}$), Confidence Decay, Frustum Projection, and Spatial SDD. |
| ⚙️ Configuration & IDE Setup | Auto-Initialization details, Environment Variables, and Editor Configs (Cursor, VS Code, Claude, Windsurf). |
| 🛠️ CLI Command Reference | CLI flags (init, run, view, stats, inspect, map, export, import, doctor, snapshot, spec, blackboard). |
| 🧰 Tools & API Reference | Complete reference for all 15 Consolidated MCP Tools, legacy tool mapping, and parameter examples. |
| 🗄️ Database Schema | SQLite tables (entities, spatial_relations, entity_history, spatial_specs, blackboard_items, evidence_packs). |
| 🎮 Interactive 3D Game Arena Demo | Autonomous 3D browser arena with Three.js bridge diagnostics (window.__WORLD_MODEL_BRIDGE). |
| 🧭 Examples & Tutorials | Deep-dive examples: Spatial Navigation, Perception Reconciliation, and Multi-Agent Blackboard. |
📖 Agent Playbook: 5-Step Canonical Workflow
When an autonomous AI agent enters a repository with world-model-mcp:
1. Orient & Explore ──▶ get_spatial_map(format: "summary") + get_expected_view(fov: 90)
2. Query & Locate ──▶ query_entities(query: "chest", radius: 15) + query_entities(entity_id: "...")
3. Plan & Simulate ──▶ simulate_movement(mode: "navigate") + manage_spatial_spec(action: "verify")
4. Execute & Ingest ──▶ generate_game_inputs(...) + ingest_observation(reconcile: true)
5. Record & Evidence ──▶ record_outcome(...) + create_evidence_pack(task_id: "...")
🧪 Testing
# Run full unit, integration, and geometry stress test suite across 47 test files (206 tests)
npm test
# Run multi-Node matrix test suite across Node.js 18, 20, and 22
npm run test:matrix
# Run 3D geometry, projection, and Playwright game loop tests
npm run test:3d
⚖️ License & Disclaimers
Developed and maintained by PuterVision. Released under the MIT License.
- Local Storage Guarantee: All spatial coordinates, bounding volumes, and entity history remain 100% local in your workspace. No telemetry or project data is ever transmitted.
- Trademarks & Non-Affiliation: Product names (Cursor, Claude Code, Gemini, Windsurf, VS Code, GitHub, SQLite, Three.js, Playwright) are property of their respective owners and used solely for compatibility identification.
Related MCP servers

Strategic BDI reasoning engine for autonomous AI agents with goal decomposition, utility theory, and adaptive replanning.

Behavior Runtime MCP
High-frequency (~60Hz) in-browser behavior tree execution engine with reactive triggers and safety guardrails for AI agents.

State Memory MCP
Deterministic, persistent SQLite graph for AI agents to track workflow state, decisions, and blockers with zero infrastructure.

Visual Memory MCP
Local visual UI cache for AI agents using perceptual hashing and CLIP to reduce vision token costs.

io.github.putput-io-dev/putput-mcp
File uploads for AI agents. Upload, list, and manage files. No signup required.

MCP server for AI image generation via OpenAI, Stable Diffusion (SD WebUI), or placeholders.