usability-test-plan
owl-listener/designer-skills
Design comprehensive usability test plans with research questions, methodology, participant criteria, and facilitation guides.
What is usability-test-plan?
Creates a complete usability test plan for evaluating designs and prototypes. Use this skill when planning the overall study structure, research questions, and methodology. For writing individual task scenarios within the test, use the separate `test-scenario` skill.
- Define research questions and study objectives
- Specify methodology (moderated/unmoderated, remote/in-person, think-aloud protocol)
- Establish participant screening criteria and sample size recommendations
- Design 5-8 task scenarios with success criteria and completion time estimates
- Select metrics (task success rate, time on task, error rate, SUS/SEQ scores, satisfaction)
- Create facilitation guide with introduction script, task delivery, probing questions, and debrief structure
How to install usability-test-plan
npx skills add https://github.com/owl-listener/designer-skills --skill usability-test-planHow to use usability-test-plan
- 1.Provide the design or prototype files you want to test (optional but recommended)
- 2.Specify the product, feature, or design context you're evaluating
- 3.The skill will generate research questions tailored to your objectives
- 4.Review and customize the participant screening criteria for your target audience
- 5.Adapt the task scenarios and metrics to match your specific study goals
- 6.Use the facilitation guide script during your test sessions
- 7.Follow the data collection template and analysis plan to synthesize results
Use cases
- Planning a usability study for a new product feature before conducting sessions
- Designing a remote moderated test for evaluating a mobile app redesign
- Setting up an unmoderated study to test a prototype with distributed participants
- Creating a pilot test checklist to validate your test plan before full rollout
- Establishing consistent metrics and success criteria across multiple test rounds
- UX researchers planning usability studies
- Product managers designing validation studies for new features
- Designers preparing to test prototypes with users
- Teams conducting iterative design evaluation
- Organizations establishing standardized testing methodologies
usability-test-plan FAQ
Use this skill to design the overall test plan, research questions, methodology, and participant criteria. Use `test-scenario` when you need to write individual task scenarios and success criteria within your test plan.
The skill recommends 5-8 participants per segment as a starting point. The exact number depends on your research questions, participant diversity, and whether you're doing moderated or unmoderated testing.
Yes. The skill supports both remote and in-person methodologies. You can specify your preference, and the plan will adapt the facilitation guide, data collection approach, and logistics accordingly.
Start with task success rate and time on task as primary metrics. Add error rate, satisfaction ratings, and standardized scales (SUS/SEQ) based on your research questions and what decisions the data will inform.
The skill includes a pilot test checklist to verify your tasks are clear, timing estimates are accurate, and your facilitation guide works as intended. Run 1-2 pilot sessions before your full study.
Full instructions (SKILL.md)
Source of truth, from owl-listener/designer-skills.
name: usability-test-plan
description: Design a usability study — research questions, methodology, participant criteria, metrics, and facilitation guide. Use when planning the study as a whole. For writing the task scenarios inside it, use test-scenario (prototyping-testing).
Usability Test Plan
Design a comprehensive usability test plan for evaluating designs and prototypes.
Context
You are a senior UX researcher designing a usability test plan for $ARGUMENTS. If the user provides files (prototypes, designs, personas), read them first.
Instructions
- Define objectives: What specific questions should this test answer?
- Create the test plan with:
- Research questions: 3-5 specific questions to answer
- Methodology: Moderated vs unmoderated, remote vs in-person, think-aloud protocol
- Participants: Screening criteria, sample size (5-8 per segment), recruitment approach
- Tasks: 5-8 realistic task scenarios with success criteria and expected completion time
- Metrics: Task success rate, time on task, error rate, SUS/SEQ scores, satisfaction rating
- Facilitation guide: Script for introduction, task delivery, probing, and debrief
- Data collection: What to record, observation template, note-taking framework
- Analysis plan: How findings will be synthesized and prioritized
- Include a pilot test checklist: What to verify before the real sessions.
- Think step by step. Present in a ready-to-use format.
Further Reading
- Rocket Surgery Made Easy — Steve Krug
- Measuring the User Experience — Tom Tullis and Bill Albert
Related skills
More from owl-listener/designer-skills and the wider catalog.
user-flow-diagram
Diagram screen-level paths, decisions, and branches to map feature traversal.
user-persona
Build research-grounded personas with goals, frustrations, and behavioral patterns for consistent user reference.
ux-writing
Write clear, helpful interface copy that guides users through your product.
version-control-strategy
Define versioning strategy for design files, components, and libraries to keep collaboration organized and traceable.
visual-hierarchy
Establish visual hierarchy through size, weight, color, spacing, and position to guide user attention.
von-restorff-effect
Make one element stand out by differentiating it from its surroundings to capture attention and memory.