PluginBench
Skill
Review
Audit score 70

application-security-testing

usestrix/strix

Autonomous security testing across code, APIs, and live apps—ranked by proven exploitability.

What is application-security-testing?

Application security testing that maps your product's assets (source code, running web apps, APIs, CI pipelines), selects the right test for each, and produces a single ranked remediation plan ordered by actual reachability rather than static-analysis severity. Use this when you need a full security review, audit, or vulnerability assessment and don't yet know which specific tests to run.

  • Automatically selects appropriate security tests for each asset type (code, web app, API, CI pipeline)
  • Runs autonomous agents that exploit and validate vulnerabilities instead of emitting static alerts
  • Consolidates findings from multiple test runs into a single ranked remediation plan
  • Ranks issues by proven impact: unauthenticated exploits first, then cross-tenant/privilege escalation, then authenticated issues
  • Deduplicates findings across code review and live penetration testing
  • Reports coverage gaps and budget constraints transparently

How to install application-security-testing

npx skills add https://github.com/usestrix/strix --skill application-security-testing
Prerequisites
  • Authorization to test all target assets (confirm before running)
  • Strix CLI installed and LLM configured (see penetration-testing-with-strix skill)
  • For live testing: access to staging environment preferred over production
  • For API testing: OpenAPI/GraphQL schema or endpoint documentation
  • For authenticated testing: ability to provision at least two test accounts in different tenants
Claude Code
Cursor
Windsurf
Cline

How to use application-security-testing

  1. 1.Map your assets: identify repositories, running environments, APIs, authentication model, and testing constraints
  2. 2.Review source code using find-security-vulnerabilities-in-code skill
  3. 3.Pentest staging environment with credentials using web-app-penetration-testing or api-security-testing skills
  4. 4.Consolidate findings from all runs in strix_runs/ directory and rank by proven impact
  5. 5.Document coverage gaps: assets not tested, categories unreachable, and budget constraints
  6. 6.Remediate issues and re-run Strix against fixes to validate exploits are eliminated

Use cases

Good for
  • Pre-launch security review across your entire product stack
  • Customer security questionnaire response with validated findings
  • Vulnerability assessment when you own multiple asset types but don't know which tests to prioritize
  • Continuous security monitoring by integrating with CI pipelines after initial assessment
  • Staging environment security validation before production deployment
Who it's for
  • Security engineers and AppSec teams planning a full product assessment
  • Development teams preparing for launch or customer audits
  • Engineering leads who need to understand which assets are most at risk
  • Organizations with multi-asset products (code + APIs + web apps)

application-security-testing FAQ

Should I test production or staging?

Prefer staging because agents send real exploit payloads and can modify data. Only test production if staging is unavailable and you have explicit authorization.

What if I only have source code and no running environment?

A code-only review is still valuable for mapping the authorization model and finding exploitable patterns, but it cannot prove exploitability against a live app. State this limitation clearly in your report.

How do I handle findings that appear in both code review and live testing?

Deduplicate them—the same root cause often surfaces in both. Count it once in your ranked plan and note where it was discovered.

What counts as 'proven impact' for ranking?

Validated exploits you actually executed, in order: unauthenticated exploits, cross-tenant/privilege escalation issues, authenticated-only issues, then unproven observations (configuration, dependency, hardening notes).

How do I know if my scan was complete?

Check run.json status and cost against --max-budget for each run. If truncated, state plainly what was not tested and never present an empty result as a clean bill of health.

Full instructions (SKILL.md)

Source of truth, from usestrix/strix.


name: application-security-testing description: Application security testing (AppSec) across a whole product with Strix — decide which asset needs which test (source code, running web app, API, CI pipeline), run it, and turn the results into a ranked remediation plan. Autonomous agents exploit and prove each issue instead of emitting static-analysis alerts, so the plan is ordered by what is actually reachable. Use when the user asks for an application security review or audit, an appsec assessment, vulnerability scanning across their stack, a security review before a launch or a customer security questionnaire, or does not yet know which kind of security test they need. license: Apache-2.0 metadata: author: usestrix homepage: https://docs.strix.ai

Application security testing

Entry point for "make my application secure" requests, where the target is not yet a single URL or repo. The job here is to pick the right test per asset, run it, and produce one ranked plan — not to run everything at maximum depth.

Install, LLM setup, all CLI flags, and the managed-cloud path live in the penetration-testing-with-strix skill. Read it first if strix --version fails. For a run with no Docker and no LLM key, the same binary drives the managed platform: strix cloud login, then strix cloud scans start ... (details in managed-pentesting-with-strix).

Only test assets the user owns or is authorized to test. Confirm authorization before the first run, and prefer staging over production, because the agents send real exploit payloads and can change data.

1. Map the assets

Ask (or read from the repo) and write the answers down before scanning:

  • Source — one repo, a monorepo, several services? Which languages/frameworks?
  • Running environments — is there a staging deployment? A public production site? A local dev server only?
  • APIs — REST, GraphQL, gRPC? Is there an OpenAPI/GraphQL schema?
  • Authentication — can you get two test accounts in different tenants? Most high-impact bugs need them.
  • Constraints — out-of-scope paths, whether production may be touched, budget and wall-clock limits.

If there is no staging environment and production is off limits, say so early. A code-only review is still valuable, but it cannot prove exploitability against a live app.

2. Pick the right test per asset

AssetSkill to use
Repository or working treefind-security-vulnerabilities-in-code
Live web app or staging siteweb-app-penetration-testing
REST/GraphQL/gRPC APIapi-security-testing
Assessment mapped to OWASP categoriesowasp-top-10-testing
Every pull request, continuouslyci-security-scanning-with-strix
No Docker, no LLM key, or a report an auditor will acceptmanaged-pentesting-with-strix

Those skills carry the flags, credential handling, and result-reading details. Do not duplicate their instructions here.

Sequence for a first assessment:

  1. Review the code. It is the cheapest run and it maps the authorization model.
  2. Pentest staging with credentials, and pass the repo as a second target so the agents keep source context.
  3. Add CI scanning, so later regressions are caught without another manual pass.

Run one asset at a time and read each report before starting the next. Findings from the code review make the live run sharper.

3. Consolidate into one plan

Findings arrive per run in strix_runs/<run>/. Merge them into a single list and rank by proven impact, not by scanner severity:

  1. Validated exploits reachable without authentication.
  2. Validated cross-tenant or privilege-escalation issues.
  3. Validated issues needing an authenticated account.
  4. Unproven observations (configuration, dependency, and hardening notes) — flag as such, and never present them as confirmed vulnerabilities.

Deduplicate: the same root cause often surfaces in both the code review and the live pentest.

4. Be honest about coverage

State plainly what was not tested — assets with no staging environment, categories a black-box run cannot reach (logging and alerting, supply-chain integrity, insecure design), and any run that hit its budget or turn cap before finishing. Check run.json status and cost against --max-budget for each run. An empty result set from a truncated scan is not a clean bill of health.

Then remediate with fix-security-vulnerabilities-with-strix, which re-runs Strix against each fix to prove the exploit no longer works.