PluginBench
Skill
Review
Audit score 70

cargo-diagnostics

getcargohq/cargo-skills

Trace runs node-by-node, sweep batches for errors, and attribute credit spend to diagnose workflow failures.

What is cargo-diagnostics?

Post-execution forensics for Cargo workflows: trace individual runs to understand what happened, sweep batches to find error patterns, and profile credit spend by node and provider. Use this when a run failed, succeeded with wrong output, or cost more than expected.

  • Trace a single run end-to-end with per-node executions, outputs, branch routing, and timing
  • Draw the execution graph with failing steps marked to diagnose routing bugs
  • Sweep batches or plays for errors grouped by root cause with exemplar run UUIDs
  • Attribute credit spend down to individual nodes and providers
  • Resolve symptoms ("why did this fail?") to run UUIDs when you don't have one
  • Profile cost levers and execution charges separately from provider costs

How to install cargo-diagnostics

npx skills add https://github.com/getcargohq/cargo-skills --skill cargo-diagnostics
Prerequisites
  • @cargo-ai/cli installed globally or available via npx
  • Signed in with `cargo-ai login --email`, `--oauth`, or `--token`
  • Admin-level token for credit attribution; standard token for run tracing and error sweeps
Claude Code
Cursor
Windsurf
Cline

How to use cargo-diagnostics

  1. 1.Install @cargo-ai/cli globally: `npm install -g @cargo-ai/cli`
  2. 2.Sign in: `cargo-ai login --email you@company.com` (or use --oauth or --token)
  3. 3.Confirm access: `cargo-ai whoami`
  4. 4.For a single run: use `references/run-trace.md` to resolve a symptom to a UUID, then trace with `cargo-ai orchestration run get <uuid>`
  5. 5.For batch errors: use `references/batch-error-sweep.md` to find and group failures
  6. 6.For cost analysis: use `references/play-optimize-credits.md` and `cargo-ai billing usage get-metrics`
  7. 7.Draw the graph: `cargo-ai orchestration node diagram --run-uuid <uuid> --highlight <slug> --format ascii`

Use cases

Good for
  • A record failed or produced empty/wrong output — trace the run to find which node broke and why
  • Error rate spiked in a batch — sweep for patterns, group by root cause, pick exemplars to investigate
  • A workflow is burning credits unexpectedly — attribute spend by node and provider to find the expensive step
  • A run took the wrong branch or skipped a step — draw the graph to see fallback edges and routing logic
  • Batch succeeded but half the rows are missing — trace a failed record and a succeeded record to compare
Who it's for
  • Workflow operators troubleshooting failed or incorrect runs
  • Data engineers optimizing workflow cost and performance
  • Platform teams investigating batch error patterns
  • Anyone diagnosing why a Cargo run behaved unexpectedly

cargo-diagnostics FAQ

When should I use this instead of cargo-analytics?

Use diagnostics to explain why something happened ("why did this run fail?", "why is this output wrong?"). Use analytics to measure and export ("what's the error rate?", "download the batch results"). Diagnostics starts from an analytics signal and ends back in analytics after the fix.

I don't have a run UUID. How do I find one?

Use `references/run-trace.md` § 0 to resolve a symptom to a UUID. Note that `orchestration run list` requires `--workflow-uuid` and cannot answer open-ended queries — use orchestration SQL over the `runs` table instead.

How do I know if a step was skipped or failed?

Draw the graph with `cargo-ai orchestration node diagram --run-uuid <uuid>` to see `on failure` edges. A step that looks skipped may have been reached via a `fallbackChildUuid` edge, meaning the provider errored rather than returning nothing — a different diagnosis.

Can I re-run records to test a fix?

Yes, but start with a pilot: re-run 10–20 records first, report the observed cost and hit-rate, then ask for approval on the full batch with a credit estimate. Never re-bill without explicit approval.

What if the evidence contradicts the docs?

File a report. If a field is missing from `run get`, a query cap doesn't match, or an error makes no sense, that's a bug to escalate.

Full instructions (SKILL.md)

Source of truth, from getcargohq/cargo-skills.


name: cargo-diagnostics description: "Explain what a Cargo run or batch actually did, after the fact — trace one run node by node, draw the graph it executed with the failing step marked, sweep a batch or play for errors grouped by root cause, and attribute credit spend down to the node and the provider. Triggers: "why did this fail", "it succeeded but the output is wrong", "half my rows are empty", "why is this column blank", "what broke in this batch", "why did that cost so much", "which node is burning credits", "it worked yesterday", "these results look wrong", "it went down the wrong path", "this step never ran", "show me what the run did". Skip when: setting up an alert for next time — use cargo-observability; just downloading the data — use cargo-analytics." version: "1.4.0" compatibility: Requires @cargo-ai/cli (npm). Sign in or create an account with cargo-ai login --email (emailed code, no browser), --oauth, or an API token homepage: https://github.com/getcargohq/cargo-skills metadata: author: getcargo openclaw: requires: bins: - cargo-ai install: - kind: node package: "@cargo-ai/cli@latest" bins: - cargo-ai homepage: https://github.com/getcargohq/cargo-skills

Cargo CLI — Diagnostics

Forensic runbooks for workflow behavior: trace one run, sweep a batch for errors, profile a play's credit spend. This skill is the interpretation layer — the raw surfaces (run get, orchestration SQL, billing metrics) are documented in cargo-orchestration and cargo-billing; each runbook here tells you which of them to pull, in what order, and what each output shape means.

Bootstrap

Already signed in (cargo-ai whoami returns a workspace)? Skip to the next section.

npm install -g @cargo-ai/cli            # no global install? prefix every command with `npx @cargo-ai/cli`
cargo-ai login --email you@company.com  # emailed code, no browser; creates the account on first use
                                        # alternatives: --oauth (browser) · --token <api-token> (CI)
cargo-ai whoami                         # confirm the active workspace before any write

Every command prints JSON to stdout; failures exit non-zero with {"errorMessage": "..."}. Anything that creates a run or a batch is async — pass --wait-until-finished or poll the matching get. Credit attribution steps (billing usage get-metrics, billing subscription get) need a token with admin access; everything else works with a standard token. When the full skill bundle is installed, ../cargo/references/prerequisites.md adds the CLI version pin, token scopes, and the admin-only surface.

Which runbook?

What are you diagnosing?
│
├── One run / one record ("why did this record fail?",
│   "run succeeded but the output is wrong/empty")
│   └── references/run-trace.md
│
├── Many runs ("the batch has errors", "error rate spiked",
│   "which node keeps failing?")
│   └── references/batch-error-sweep.md
│
└── Cost ("this play is expensive", "where do the credits go?",
    "make this cheaper")
    └── references/play-optimize-credits.md

Rule of thumb: start with the sweep when you don't yet know which run to look at — it ends by handing you exemplar run UUIDs to feed into the trace.

No run UUID at all ("look at the last run", "the run for acme.com", "what did my play do in the editor")? That's references/run-trace.md § 0, which resolves a symptom to a UUID. Note that orchestration run list requires --workflow-uuid and cannot answer it — orchestration SQL over runs takes no filter and can. Never conclude that run inputs and outputs are inaccessible because run list refused.

Boundary with cargo-analytics: analytics measures and exports ("what's the error rate?", "download the batch results", "export this segment"); this skill explains ("why is the error rate up?", "why is this record's output empty?"). A diagnosis often starts from an analytics signal (error count spiked, batch reports failedRunsCount > 0) and ends back in analytics — once the cause is fixed and runs re-executed, bulk retrieval goes through run download-outputs / batch download / segment download, all documented in ../cargo-analytics/SKILL.md. This skill's evidence surfaces (run get, orchestration SQL, billing metrics) are for diagnosis, not bulk export.

References

DocWhat it covers
references/run-trace.mdFind a run from a symptom when you have no UUID (§ 0), then walk it end-to-end: per-node executions, runContext outputs, branch routing, per-node credits and timing.
references/batch-error-sweep.mdFind errored runs across a batch/play/workspace, group failures by root cause, pick exemplars, decide fix vs report.
references/play-optimize-credits.mdAttribute credit spend to workflows and nodes, then apply the cost levers in priority order. Attributes the execution charge separately (§ 2b) — 0.01 credits per node execution, which creditsUsedCount does not carry and per-node attribution therefore misses.

The surfaces every runbook draws on

SurfaceCommandGives you
Run detailcargo-ai orchestration run get <run-uuid>run.executions[] (node-by-node trace), runContext (per-node output keyed by nodeSlug), runComputedConfigs (what each node was actually called with)
Orchestration SQLcargo-ai orchestration query execute "<sql>"Aggregates over runs, batches, spans, records (ClickHouse; no schema prefix; workspace-scoped)
Billing metricscargo-ai billing usage get-metrics --from <date> --to <date>Credit totals, filterable and groupable by workflow_uuid, connector_uuid, agent_uuid, integration_slug, model_uuid
Graph picturecargo-ai orchestration node diagram --run-uuid <uuid> --highlight <slug> --format ascii --rawThe graph the run executed, with the failing node marked. Free, runs nothing

Draw the graph before explaining a routing bug. For "it took the wrong branch" or "this step never ran", the picture is the evidence, and it shows one thing run get does not make obvious: the on failure edges. A step that looks skipped is often one the run reached via a fallbackChildUuid edge, which means the provider errored rather than returning nothing — a different diagnosis with a different fix. Flags and the ASCII legend: ../cargo-orchestration/references/node-diagram.md.

Full query syntax, table columns, and caps: ../cargo-orchestration/references/examples/queries.md. Debugging field semantics: ../cargo-orchestration/references/troubleshooting.md.

Presenting findings

Follow ../cargo/references/interaction.md: lead with the conclusion ("18 of 20 failures are one cause: the connector's token expired"), summarize evidence in a short table, never dump raw run get JSON or full query results into the conversation. Any fix that re-runs paid nodes goes through the pilot gate: re-run 10–20 records first, report the observed cost and hit-rate, then ask the user to approve the rest quoting the record count and credit estimate — a diagnosis is not approval to re-bill the batch that produced it. Full spend rules in ../cargo-gtm/references/cost-discipline.md.

When diagnosis dead-ends

If the evidence contradicts documented behavior (a field missing from run get, a query cap that doesn't match the docs, an error that makes no sense), file a report — that's the official channel and the team reads every one:

cargo-ai workspaceManagement report create \
  --title "<one-line summary>" \
  --description "<commands run, errorMessage verbatim, expected vs actual, UUIDs>"