PluginBench
Skill
Pass
Audit score 90

launchdarkly-guarded-rollout

launchdarkly/ai-tooling

Configure progressive feature rollouts with automatic monitoring and rollback in LaunchDarkly.

What is launchdarkly-guarded-rollout?

Guides you through setting up guarded rollouts that gradually increase traffic to new feature variations while monitoring metrics for regressions. Use this when releasing features safely with automatic pause or rollback if performance degrades.

  • Design multi-stage rollout progression with configurable traffic percentages
  • Monitor selected metrics during each stage to detect performance regressions
  • Automatically pause, notify, or rollback when regression thresholds are breached
  • Inspect flag configurations and available metrics before starting a rollout
  • Stop active rollouts immediately if issues are detected

How to install launchdarkly-guarded-rollout

npx skills add https://github.com/launchdarkly/ai-tooling --skill launchdarkly-guarded-rollout
Prerequisites
  • LaunchDarkly MCP server configured in your environment
  • Access to a LaunchDarkly project with at least one feature flag
  • Metrics already defined in LaunchDarkly or ability to create them
Claude Code
Cursor
Windsurf
Cline

How to use launchdarkly-guarded-rollout

  1. 1.Run `get-flag` to inspect your feature flag and identify the test and control variation IDs
  2. 2.Run `list-metrics` to find available metrics for monitoring regressions
  3. 3.Ensure the flag is enabled in your target environment using `toggle-flag` if needed
  4. 4.Design your rollout stages with traffic percentages and monitoring windows (e.g., 1% for 1 hour, 10% for 24 hours)
  5. 5.Configure metrics with regression thresholds and actions (notify, rollback, or both)
  6. 6.Call `start-guarded-rollout` with your stages and metrics configuration
  7. 7.Verify the rollout is active by running `get-flag` again and monitor for regression notifications

Use cases

Good for
  • Rolling out a new checkout flow to 1% of users, then 10%, 50%, and 100% while monitoring error rates and conversion
  • Releasing a redesigned API endpoint with latency and error-rate monitoring to catch performance issues early
  • Gradually migrating users to a new database backend with automatic rollback if query latency increases beyond 20%
  • Testing a new recommendation algorithm on a small percentage of traffic before full deployment
Who it's for
  • Engineering teams managing feature releases in production
  • DevOps and platform engineers overseeing safe deployment practices
  • Product managers coordinating phased feature rollouts
  • SREs monitoring system health during infrastructure changes

launchdarkly-guarded-rollout FAQ

What are rollout weights and how do I specify them?

Rollout weights use basis points (thousandths): 1000 = 1%, 10000 = 10%, 50000 = 50%, 100000 = 100%. Use these values in the rolloutWeight field for each stage.

How long should each monitoring window be?

Monitoring windows depend on your traffic volume and metric stability. Typical patterns: 1 hour (3600000 ms) for smoke tests at low traffic, 24 hours (86400000 ms) for higher traffic stages to gather sufficient signal.

What happens if a regression is detected?

LaunchDarkly can notify your team, automatically rollback to the control variation, or both—depending on your onRegression configuration. You can also manually stop a rollout with `stop-guarded-rollout`.

Can I start a guarded rollout if the flag is currently off?

No. The flag must be enabled in the target environment first. Use `toggle-flag` to turn it on before calling `start-guarded-rollout`.

What if I don't have suitable metrics defined yet?

Use the optional `create-metric` tool to define new metrics before starting the rollout. Metrics should reflect user experience (error rates, latency, conversion) rather than internal implementation details.

Full instructions (SKILL.md)

Source of truth, from launchdarkly/ai-tooling.


name: launchdarkly-guarded-rollout description: "Configure guarded rollouts with progressive traffic increases, metric monitoring, and automatic rollback. Use when releasing features gradually with safety thresholds." license: Apache-2.0 compatibility: Requires the remotely hosted LaunchDarkly MCP server metadata: author: launchdarkly version: "0.1.0"

LaunchDarkly Guarded Rollouts

You're using a skill that will guide you through configuring guarded rollouts in LaunchDarkly. Your job is to design rollout stages, select monitoring metrics, configure regression thresholds, and start the rollout.

Prerequisites

This skill requires the remotely hosted LaunchDarkly MCP server to be configured in your environment.

Required MCP tools:

  • start-guarded-rollout -- start a progressive rollout with monitoring
  • get-flag -- inspect the flag and its variations
  • list-metrics -- find metrics to monitor during the rollout

Optional MCP tools:

  • stop-guarded-rollout -- halt an active rollout immediately
  • toggle-flag -- ensure the flag is turned on before starting
  • create-metric -- create metrics if they don't exist

Core Concepts

What Are Guarded Rollouts?

A guarded rollout progressively increases traffic to a new feature flag variation through a series of stages. At each stage, LaunchDarkly monitors selected metrics for regressions. If a regression is detected, the rollout can automatically pause and notify the team — or even roll back.

Key Components

ComponentDescription
Test variationThe new variation being rolled out
Control variationThe existing/baseline variation
StagesSteps with increasing traffic percentage and monitoring windows
MetricsWhat to monitor for regressions (error rate, latency, etc.)
Regression thresholdHow much a metric can degrade before triggering action
On regressionWhether to notify, rollback, or both when a threshold is breached

Rollout Weight Units

Rollout weights use thousandths (basis points):

  • 1000 = 1%
  • 10000 = 10%
  • 50000 = 50%
  • 100000 = 100%

Monitoring Window

The monitoring window is specified in milliseconds:

  • 3600000 = 1 hour
  • 86400000 = 24 hours
  • 604800000 = 7 days

Core Principles

  1. Start Small: Begin with a low percentage (1-5%) to catch issues early
  2. Monitor What Matters: Choose metrics that reflect user experience
  3. Set Realistic Thresholds: Too tight = false alarms; too loose = missed regressions
  4. Allow Time: Each stage needs enough monitoring time for signal to emerge
  5. Have a Rollback Plan: Always configure at least notification on regression

Workflow

Step 1: Prepare

Before starting a guarded rollout:

  1. Use get-flag to inspect the flag — note the variation IDs for test and control
  2. Use list-metrics to find metrics suitable for monitoring
  3. Ensure the flag is on in the target environment (use toggle-flag if needed)
  4. Confirm there's no active guarded rollout on this flag already

Step 2: Design Stages

Plan the rollout progression. A typical pattern:

StageTrafficMonitoring WindowPurpose
11%1 hourSmoke test — catch obvious crashes
210%24 hoursEarly signal on metrics
350%24 hoursConfidence building
4100%24 hoursFull rollout with monitoring

Step 3: Configure Metrics

Select metrics that indicate problems:

Metric TypeExampleThresholdAction
Error rateapi-error-rate0.05 (5% increase)Rollback
Latencyp99-response-time0.2 (20% increase)Notify
Conversioncheckout-completed0.1 (10% decrease)Notify + Rollback

Step 4: Start the Rollout

Use start-guarded-rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production",
  "testVariationId": "variation-id-for-new-flow",
  "controlVariationId": "variation-id-for-current-flow",
  "randomizationUnit": "user",
  "stages": [
    {"rolloutWeight": 1000, "monitoringWindowMilliseconds": 3600000},
    {"rolloutWeight": 10000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 50000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 100000, "monitoringWindowMilliseconds": 86400000}
  ],
  "metrics": [
    {
      "metricKey": "api-error-rate",
      "onRegression": {"notify": true, "rollback": true},
      "regressionThreshold": 0.05
    },
    {
      "metricKey": "checkout-completed",
      "onRegression": {"notify": true, "rollback": false},
      "regressionThreshold": 0.1
    }
  ]
}

Step 5: Verify

  1. Use get-flag to confirm the guarded rollout is active
  2. Check that the flag shows the rollout configuration in the environment
  3. Monitor for any immediate regression notifications

Report results:

  • Guarded rollout started with N stages
  • M metrics being monitored
  • First stage at X% traffic for Y hours

Stopping a Rollout

If issues arise or you need to halt the rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production"
}

This immediately stops the progressive rollout and locks the flag at its current state.

Edge Cases

SituationAction
Flag is offTurn it on first with toggle-flag — rollouts require the flag to be on
Active rollout existsStop it first with stop-guarded-rollout before starting a new one
No suitable metricsCreate metrics first with create-metric
Approval requiredIf the environment requires approvals, the tool will return an approval URL

What NOT to Do

  • Don't start a guarded rollout on a flag that's turned off
  • Don't skip the monitoring window design — rushing through stages defeats the purpose
  • Don't set regression thresholds to 0 — small fluctuations are normal
  • Don't forget to configure at least one metric — a rollout without monitoring is just a regular rollout