PluginBench
Skill
Official
Pass
Audit score 90

launchdarkly-guarded-rollout

launchdarkly/agent-skills

Configure progressive feature rollouts with automated metric monitoring and safety rollbacks in LaunchDarkly.

What is launchdarkly-guarded-rollout?

Set up guarded rollouts that gradually increase traffic to new feature variations while monitoring key metrics for regressions. Use this when releasing features safely with automatic pause or rollback if performance degrades beyond configured thresholds.

  • Design multi-stage rollout progression with increasing traffic percentages
  • Select and configure metrics to monitor during each rollout stage
  • Set regression thresholds that trigger notifications or automatic rollbacks
  • Start progressive rollouts with automated safety controls
  • Stop active rollouts immediately if issues are detected
  • Inspect flag configurations and available metrics for monitoring

How to install launchdarkly-guarded-rollout

npx skills add https://github.com/launchdarkly/agent-skills --skill launchdarkly-guarded-rollout
Prerequisites
  • LaunchDarkly MCP server remotely hosted and configured in your environment
  • Access to a LaunchDarkly project with flag management permissions
  • Feature flag already created with at least two variations (test and control)
Claude Code
Cursor
Windsurf
Cline

How to use launchdarkly-guarded-rollout

  1. 1.Run `get-flag` to inspect the target flag and identify variation IDs for test and control versions
  2. 2.Run `list-metrics` to discover available metrics for monitoring during rollout
  3. 3.Ensure the flag is enabled in the target environment using `toggle-flag` if needed
  4. 4.Design rollout stages with traffic percentages (e.g., 1%, 10%, 50%, 100%) and monitoring windows (e.g., 1 hour, 24 hours)
  5. 5.Configure metrics with regression thresholds and actions (notify, rollback, or both)
  6. 6.Call `start-guarded-rollout` with your stage and metric configuration
  7. 7.Monitor the rollout progress and verify metrics are being tracked
  8. 8.Use `stop-guarded-rollout` if you need to halt the rollout at any point

Use cases

Good for
  • Rolling out a new checkout flow to 1% of users first, then 10%, 50%, and 100% while monitoring error rates and conversion metrics
  • Gradually releasing a redesigned API endpoint with automatic rollback if latency increases by more than 20%
  • Progressive deployment of a database schema change with monitoring for query performance regressions
  • Staged launch of a machine learning model variant with automatic pause if prediction accuracy drops below threshold
Who it's for
  • Release engineers managing feature deployments
  • Product managers coordinating gradual feature rollouts
  • DevOps teams implementing safe deployment practices
  • Engineering leads overseeing production changes with risk mitigation

launchdarkly-guarded-rollout FAQ

What are rollout weight units?

Rollout weights use basis points (thousandths): 1000 = 1%, 10000 = 10%, 50000 = 50%, 100000 = 100%.

How long should each monitoring window be?

Monitoring windows depend on your metric volatility. Typical values: 1 hour (3600000 ms) for smoke tests, 24 hours (86400000 ms) for stable signal detection, 7 days (604800000 ms) for long-term trends.

What happens if a regression is detected?

The rollout can notify your team, automatically rollback to the control variation, or both — depending on your configuration for each metric.

Can I stop a rollout in progress?

Yes, use `stop-guarded-rollout` to immediately halt the progressive rollout and lock the flag at its current state.

What if the flag is turned off?

Guarded rollouts require the flag to be on. Use `toggle-flag` to enable it before starting the rollout.

Full instructions (SKILL.md)

Source of truth, from launchdarkly/agent-skills.


name: launchdarkly-guarded-rollout description: "Configure guarded rollouts with progressive traffic increases, metric monitoring, and automatic rollback. Use when releasing features gradually with safety thresholds." license: Apache-2.0 compatibility: Requires the remotely hosted LaunchDarkly MCP server metadata: author: launchdarkly version: "0.1.0"

LaunchDarkly Guarded Rollouts

You're using a skill that will guide you through configuring guarded rollouts in LaunchDarkly. Your job is to design rollout stages, select monitoring metrics, configure regression thresholds, and start the rollout.

Prerequisites

This skill requires the remotely hosted LaunchDarkly MCP server to be configured in your environment.

Required MCP tools:

  • start-guarded-rollout -- start a progressive rollout with monitoring
  • get-flag -- inspect the flag and its variations
  • list-metrics -- find metrics to monitor during the rollout

Optional MCP tools:

  • stop-guarded-rollout -- halt an active rollout immediately
  • toggle-flag -- ensure the flag is turned on before starting
  • create-metric -- create metrics if they don't exist

Core Concepts

What Are Guarded Rollouts?

A guarded rollout progressively increases traffic to a new feature flag variation through a series of stages. At each stage, LaunchDarkly monitors selected metrics for regressions. If a regression is detected, the rollout can automatically pause and notify the team — or even roll back.

Key Components

ComponentDescription
Test variationThe new variation being rolled out
Control variationThe existing/baseline variation
StagesSteps with increasing traffic percentage and monitoring windows
MetricsWhat to monitor for regressions (error rate, latency, etc.)
Regression thresholdHow much a metric can degrade before triggering action
On regressionWhether to notify, rollback, or both when a threshold is breached

Rollout Weight Units

Rollout weights use thousandths (basis points):

  • 1000 = 1%
  • 10000 = 10%
  • 50000 = 50%
  • 100000 = 100%

Monitoring Window

The monitoring window is specified in milliseconds:

  • 3600000 = 1 hour
  • 86400000 = 24 hours
  • 604800000 = 7 days

Core Principles

  1. Start Small: Begin with a low percentage (1-5%) to catch issues early
  2. Monitor What Matters: Choose metrics that reflect user experience
  3. Set Realistic Thresholds: Too tight = false alarms; too loose = missed regressions
  4. Allow Time: Each stage needs enough monitoring time for signal to emerge
  5. Have a Rollback Plan: Always configure at least notification on regression

Workflow

Step 1: Prepare

Before starting a guarded rollout:

  1. Use get-flag to inspect the flag — note the variation IDs for test and control
  2. Use list-metrics to find metrics suitable for monitoring
  3. Ensure the flag is on in the target environment (use toggle-flag if needed)
  4. Confirm there's no active guarded rollout on this flag already

Step 2: Design Stages

Plan the rollout progression. A typical pattern:

StageTrafficMonitoring WindowPurpose
11%1 hourSmoke test — catch obvious crashes
210%24 hoursEarly signal on metrics
350%24 hoursConfidence building
4100%24 hoursFull rollout with monitoring

Step 3: Configure Metrics

Select metrics that indicate problems:

Metric TypeExampleThresholdAction
Error rateapi-error-rate0.05 (5% increase)Rollback
Latencyp99-response-time0.2 (20% increase)Notify
Conversioncheckout-completed0.1 (10% decrease)Notify + Rollback

Step 4: Start the Rollout

Use start-guarded-rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production",
  "testVariationId": "variation-id-for-new-flow",
  "controlVariationId": "variation-id-for-current-flow",
  "randomizationUnit": "user",
  "stages": [
    {"rolloutWeight": 1000, "monitoringWindowMilliseconds": 3600000},
    {"rolloutWeight": 10000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 50000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 100000, "monitoringWindowMilliseconds": 86400000}
  ],
  "metrics": [
    {
      "metricKey": "api-error-rate",
      "onRegression": {"notify": true, "rollback": true},
      "regressionThreshold": 0.05
    },
    {
      "metricKey": "checkout-completed",
      "onRegression": {"notify": true, "rollback": false},
      "regressionThreshold": 0.1
    }
  ]
}

Step 5: Verify

  1. Use get-flag to confirm the guarded rollout is active
  2. Check that the flag shows the rollout configuration in the environment
  3. Monitor for any immediate regression notifications

Report results:

  • Guarded rollout started with N stages
  • M metrics being monitored
  • First stage at X% traffic for Y hours

Stopping a Rollout

If issues arise or you need to halt the rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production"
}

This immediately stops the progressive rollout and locks the flag at its current state.

Edge Cases

SituationAction
Flag is offTurn it on first with toggle-flag — rollouts require the flag to be on
Active rollout existsStop it first with stop-guarded-rollout before starting a new one
No suitable metricsCreate metrics first with create-metric
Approval requiredIf the environment requires approvals, the tool will return an approval URL

What NOT to Do

  • Don't start a guarded rollout on a flag that's turned off
  • Don't skip the monitoring window design — rushing through stages defeats the purpose
  • Don't set regression thresholds to 0 — small fluctuations are normal
  • Don't forget to configure at least one metric — a rollout without monitoring is just a regular rollout