PluginBench
Skill
Official
Pass
Audit score 90

cuopt-server-api-python

nvidia/skills

Deploy and call the cuOpt REST server with Python/curl examples for routing and LP/MILP problems.

What is cuopt-server-api-python?

This skill covers starting the cuOpt REST server and writing clients against it in Python or curl. Use it when deploying the server to a target environment, mapping optimization problems to HTTP endpoints, or debugging API payloads.

  • Start the cuOpt server locally or in Docker with GPU support
  • POST optimization problems to /cuopt/request and poll /cuopt/solution/{reqId} for results
  • Translate between Python API and REST field names (e.g., order_locations → task_locations)
  • Verify server health and diagnose connection, payload, and configuration errors
  • Run example VRP, pickup-delivery, LP, and MILP problems via REST

How to install cuopt-server-api-python

npx skills add https://github.com/nvidia/skills --skill cuopt-server-api-python
Prerequisites
  • NVIDIA GPU with working CUDA driver
  • cuopt-server installed or Docker with NVIDIA Container Toolkit
  • Python clients require the requests library; no API key or auth token needed
Claude Code
Cursor
Windsurf
Cline

How to use cuopt-server-api-python

  1. 1.Start the server: python -m cuopt_server.cuopt_service --ip 0.0.0.0 --port 8000 (or docker run with --gpus all)
  2. 2.Verify health: GET http://localhost:8000/cuopt/health (expect HTTP 200)
  3. 3.POST your problem to /cuopt/request with cost_matrix_data, task_data, fleet_data, and solver_config
  4. 4.Extract reqId from the response
  5. 5.Poll /cuopt/solution/{reqId} until the solution is ready (validate reqId before interpolating into URL)
  6. 6.Parse and use the returned solution

Use cases

Good for
  • Deploy cuOpt as a microservice in Docker or Kubernetes for routing and LP/MILP solving
  • Build a Python or curl client to submit vehicle routing problems and retrieve optimized routes
  • Migrate from the Python API to REST by mapping field names and payload structure
  • Debug 422 Unprocessable Entity errors caused by schema mismatches or malformed capacity arrays
  • Set up polling loops with proper timeout and reqId validation for production clients
Who it's for
  • Backend engineers deploying optimization services
  • Data scientists building REST clients for routing or LP/MILP
  • DevOps engineers containerizing cuOpt for cloud or on-premise deployment
  • Anyone integrating cuOpt into a microservice architecture

cuopt-server-api-python FAQ

What problem types does the REST API support?

Routing and LP/MILP. Quadratic programming (QP) is not exposed over REST; use the Python or C API instead.

How do I fix a 422 Unprocessable Entity error?

Check field names against the OpenAPI spec at /cuopt.yaml. Common mistakes: transit_time_matrix_data should be travel_time_matrix_data, and capacities should be [[50, 50]] (one list per dimension), not [[50], [50]].

Does the server require authentication or TLS?

No. The server ships with no auth or TLS. Treat it as a trusted-network endpoint only and put it behind a gateway in production.

How do I run cuOpt in Docker?

Use docker run --gpus all -d -p 8000:8000 nvidia/cuopt:latest-cu13 (or latest-cu12 to match your CUDA version). Pin to a full release tag in production instead of latest-*.

What should I capture when a request fails?

Save the reqId and the full response body—both are needed to diagnose server-side rejections.

Full instructions (SKILL.md)

Source of truth, from nvidia/skills.


name: cuopt-server-api-python version: "26.10.00" description: cuOpt REST server — start server, endpoints, Python/curl client examples. Use when the user is deploying or calling the REST API. license: Apache-2.0 metadata: author: NVIDIA cuOpt Team tags: - cuopt - server - rest-api - python - deployment

cuOpt Server — Deploy and client (Python/curl)

This skill covers starting the server and client examples (curl, Python). Server has no separate C API (clients can be any language).

Purpose

Use this skill when the user is deploying the cuOpt REST server or writing a client against it — choosing a deployment target, mapping a problem onto the HTTP endpoints, translating between Python-API and REST field names, or debugging a rejected payload.

Prerequisites

  • An NVIDIA GPU with a working CUDA driver (the server requires one; --gpus all for Docker).
  • cuopt-server installed, or Docker with the NVIDIA Container Toolkit. See the install skill.
  • Python clients need requests. No API key or auth token is required by the server itself.

Problem types supported

Problem typeSupported
Routing✓
LP✓
MILP✓
QP✗

Required questions

Ask these if not already clear:

  1. Problem type — Routing or LP/MILP? (QP not available via REST.)
  2. Deployment — Local, Docker, Kubernetes, or cloud?
  3. Client — Which language or tool will call the API (e.g. Python, curl, another service)?

Start server

# Development
python -m cuopt_server.cuopt_service --ip 0.0.0.0 --port 8000

# Docker — pick the tag matching your CUDA major version
docker run --gpus all -d -p 8000:8000 -e CUOPT_SERVER_PORT=8000 \
  nvidia/cuopt:latest-cu13

Use latest-cu12 or latest-cu13 to match your driver's CUDA major version (latest-cu13-ubi10 for a UBI10 base). Prefer these over the CUDA+Python-specific tags such as latest-cuda12.9-py3.13 — those track a single Python line and go stale when it stops receiving builds.

For production, pin rather than float: latest-* tags are mutable and can silently move to a different image. Use a full release tag (nvidia/cuopt:<release>-cuda<cuda>-py<python>) or an immutable digest (nvidia/cuopt@sha256:<digest>). Check the nvidia/cuopt registry for available tags.

Verify

Confirm the server is up by requesting GET /cuopt/health on the local port (e.g. http://localhost:8000/cuopt/health) — a healthy server returns HTTP 200.

Instructions

  1. POST to /cuopt/request → get reqId
  2. Poll /cuopt/solution/{reqId} until solution ready
  3. Parse response

Treat reqId as untrusted input: validate it (e.g. re.fullmatch(r"[A-Za-z0-9_-]{1,64}", req_id)) before interpolating it into the polling URL, and set an explicit timeout on every request.

Examples

import requests, time
SERVER = "http://localhost:8000"
HEADERS = {"Content-Type": "application/json", "CLIENT-VERSION": "custom"}
payload = {
    "cost_matrix_data": {"data": {"0": [[0,10,15],[10,0,12],[15,12,0]]}},
    "travel_time_matrix_data": {"data": {"0": [[0,10,15],[10,0,12],[15,12,0]]}},
    "task_data": {"task_locations": [1, 2], "demand": [[10, 20]], "task_time_windows": [[0,100],[0,100]], "service_times": [5, 5]},
    "fleet_data": {"vehicle_locations": [[0, 0]], "capacities": [[50]], "vehicle_time_windows": [[0, 200]]},
    "solver_config": {"time_limit": 5}
}
r = requests.post(f"{SERVER}/cuopt/request", json=payload, headers=HEADERS, timeout=30)
req_id = r.json()["reqId"]
# Poll: GET /cuopt/solution/{req_id}

Terminology: REST vs Python API

Python APIREST
order_locationstask_locations
set_order_time_windows()task_time_windows
service_timesservice_times

Use travel_time_matrix_data (not transit_time_matrix_data). Capacities: [[50, 50]] not [[50], [50]].

Troubleshooting

ErrorCauseSolution
422 Unprocessable EntityField name not in the schemaCheck names against the OpenAPI spec at /cuopt.yaml. Most common: transit_time_matrix_data → travel_time_matrix_data
422 on fleet_dataCapacities nested per vehicle instead of per dimensionUse [[50, 50]] (one inner list per capacity dimension), not [[50], [50]]
Connection refusedServer not up, or bound to a different interface/portcurl http://localhost:8000/cuopt/health; start with --ip 0.0.0.0 --port 8000
Docker container exits immediatelyNo GPU visible to the containerRun with --gpus all and confirm the NVIDIA Container Toolkit is installed
Polling never returns a solutionSolve exceeds the client's poll budgetRaise solver_config.time_limit and the poll loop count together

Capture the reqId and the full response body for any failed request — both are needed to diagnose server-side rejections.

Limitations

  • QP is not exposed over REST. Use the Python or C API for quadratic objectives.
  • The server ships no authentication or TLS. Anything that can reach the port can submit jobs. Put it behind a gateway and treat --server/base URLs as trusted-network endpoints only.
  • Solutions are retrieved by polling; there is no push/webhook delivery.
  • One request is solved at a time per server process; concurrency requires multiple replicas.

Runnable assets

Run from each asset directory (server must be running; scripts exit 0 if server unreachable). All use Python requests and accept --server (default http://localhost:8000):

See assets/README.md for overview.

Escalate

For contribution or build-from-source, see the developer skill.