PluginBench
Skill
Review
Audit score 70

ai-research-explore

lllllllama/rigorpilot-skills

Auditable deep learning research exploration with idea gating, fair comparison, and governed experiments.

What is ai-research-explore?

Rigor Explore compatible skill for candidate-only exploration on top of a durable research anchor. Use when you have chosen task family, dataset, benchmark, evaluation method, and SOTA references, and want to systematically explore variants with scientific rigor, reproducibility, and auditable collaboration.

  • Understand repository structure and freeze task/dataset/evaluation/budget before exploration
  • Gate and rank candidate ideas with explicit scoring and feasibility assessment
  • Execute one bounded candidate change at a time with smoke-checking and evidence collection
  • Rank candidates against current anchor using real metrics and reproducibility notes
  • Write candidate outputs to explore_outputs/ with SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md
  • Preserve researcher-provided ideas and optionally add small bounded set of seed ideas

How to install ai-research-explore

npx skills add https://github.com/lllllllama/rigorpilot-skills --skill ai-research-explore
Prerequisites
  • Explicit exploration authorization (candidate-only work, isolated branch, or sweep)
  • Durable current_research context (branch, commit, checkpoint, or trained model state)
  • Frozen task family, dataset, benchmark, and evaluation method
  • SOTA references and compute budget defined
Claude Code
Cursor
Windsurf
Cline

How to use ai-research-explore

  1. 1.Confirm current_research anchor and exploration authorization with the researcher
  2. 2.Freeze task, dataset, benchmark, evaluation source, and SOTA reference for the campaign
  3. 3.Build repo-understanding artifacts needed for the campaign (via analyze-project if needed)
  4. 4.Preserve researcher-provided ideas and optionally add bounded seed ideas
  5. 5.Prioritize candidates by expected gain, cost, success likelihood, and rollback ease
  6. 6.Execute one clear candidate at a time using explore-code or explore-run
  7. 7.Collect real evidence: command status, metrics, artifacts, and reproducibility notes
  8. 8.Rank candidates against anchor and write outputs to explore_outputs/ with scientific metadata

Use cases

Good for
  • Explore architectural variants on a fixed benchmark with fair comparison metrics
  • Run hyperparameter sweeps on a frozen dataset and evaluation protocol
  • Test multiple loss functions or regularization approaches against a stable baseline
  • Investigate ablations of model components with auditable evidence collection
  • Rank candidate improvements before committing to full reproduction or publication
Who it's for
  • Deep learning researchers conducting systematic exploration
  • Teams needing auditable candidate evaluation before claiming novelty
  • Researchers with a durable current_research anchor (branch, checkpoint, or trained model)
  • Scientists requiring reproducible comparison boundaries and scientific changelogs

ai-research-explore FAQ

When should I use ai-research-explore vs. explore-code or explore-run?

Use ai-research-explore for full campaign management with idea gating, ranking, and scientific rigor. Use explore-code for narrow code-only adaptation and explore-run for short-cycle trials or sweeps without full campaign governance.

What should I include in a research_campaign input?

Minimal core: current_research, task_family, dataset, benchmark, evaluation_source, sota_reference, and compute_budget. Optional guidance: candidate_ideas, variant_spec, research_lookup, idea_policy, and execution_policy.

How do I preserve scientific rigor while exploring candidates?

Freeze evaluation source and SOTA reference for the campaign, rank by real evidence first, include SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md, and never present exploratory gains as trusted reproduction success.

What outputs should I write from exploration?

Write candidate-only outputs to analysis_outputs/, sources/, and explore_outputs/. Always include SCIENTIFIC_CHANGELOG.md for scientific meaning and COMPARABILITY_REPORT.md for comparison boundaries.

When should I stop exploration and request a checkpoint?

Stop when ideas are too close to distinguish, implementation cannot be decomposed into auditable units, blockers emerge, scientific meaning is unclear, budget is exhausted, or evaluation anchor is missing.

Full instructions (SKILL.md)

Source of truth, from lllllllama/rigorpilot-skills.


name: ai-research-explore description: Rigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates. Use when the researcher has chosen the task family, dataset, benchmark, evaluation method, provided SOTA references, and wants candidate-only exploration on top of current_research with auditable repo understanding, idea gating, fair comparison, and governed experiments written to explore_outputs/. Do not use for README-first trusted reproduction, open-ended direction finding, narrow code-only or run-only exploration, passive repo analysis, verified novelty claims, or implicit experimentation.

ai-research-explore

Purpose

Use this as the Rigor Explore compatible skill slug after the researcher explicitly authorizes candidate-only work on top of a durable current_research anchor. The installed slug remains ai-research-explore for compatibility. Rigor Explore is for meaningful and potentially novel deep learning research candidates while preserving scientific rigor, comparability, reproducibility, and auditable collaboration. Novelty and significance remain hypotheses before literature contrast, ablation evidence, and fair comparison. The skill does not promise autonomous discovery, global benchmark completeness, novelty proof, or trusted reproduction success.

Start from the shared operating principles in ../../references/agent-operating-principles.md, then load ../../references/research-rigor-principles.md for research claims and ../../references/deep-learning-experiment-principles.md when experiment details affect comparability or reproducibility.

Fit

Use this skill only when the request has both:

  • Explicit exploration authorization such as candidate-only work, isolated branch or worktree, sweep, several variants, or exploratory ranking.
  • A durable current_research context such as a branch, commit, checkpoint, run record, or already-trained local model state.

Keep narrow code-only requests on explore-code. Keep narrow run-only requests on explore-run. Keep passive repository analysis on analyze-project. Keep README-first reproduction on ai-research-reproduction.

Research Rhythm

Use a two-loop rhythm:

  • Outer loop: understand the repository, freeze task/dataset/evaluation/budget, preserve user ideas, map sources, gate ideas, and decide whether the next experiment is worth running.
  • Inner loop: make one bounded candidate change or run, smoke-check it, collect evidence, rank it against the current anchor, and either stop or return to the outer loop with the new evidence.

This rhythm is a guide, not a rigid autonomous loop. Stop at explicit blockers, unclear scientific meaning, exhausted budget, missing anchor/evaluation, or a human checkpoint.

Workflow

  1. Confirm current_research and explicit explore-lane authorization.
  2. Accept either legacy variant_spec or higher-level research_campaign.
  3. In campaign mode, freeze the task, dataset, benchmark, evaluation source, SOTA reference, and budget before candidate work.
  4. Build only the repo-understanding artifacts needed for the current campaign, usually through analyze-project.
  5. Run bounded, cache-first source lookup when source support matters; prefer local curated literature such as Zotero if available, then seed sources, repo-local locators, public locators, or optional web lookup. Treat lookup as source resolution, not an open-ended literature search.
  6. Preserve researcher-provided ideas, optionally add a small bounded set of single-variable seed ideas, and rank ideas with explicit gates and score breakdowns.
  7. Prefer one clear candidate at a time. Use explore-code for bounded code adaptation and explore-run for short-cycle trials or sweeps.
  8. Use minimal-run-and-audit or run-train only when the exploratory plan requires real execution evidence.
  9. Write candidate-only outputs to analysis_outputs/, sources/, and explore_outputs/ as appropriate; never present exploratory gains as trusted reproduction success. Include SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md for candidate scientific meaning and comparison boundaries.

Ranking and Evidence

  • Before execution, prioritize candidates by expected gain, cost, success likelihood, patch surface, dependency drag, evaluation risk, and rollback ease.
  • After execution, rank by real evidence first: command status, observed metrics, artifacts, changed paths, smoke results, and reproducibility notes.
  • Keep researcher-provided evaluation_source and sota_reference frozen for the campaign; do not claim they are globally complete.
  • If the top ideas are too close or the implementation cannot be decomposed into auditable units, stop for a checkpoint instead of silently choosing.

Campaign Inputs

research_campaign is preferred for Rigor Explore campaigns, but it should stay minimal. The durable core is:

  • current_research
  • task_family
  • dataset
  • benchmark
  • evaluation_source
  • sota_reference
  • compute_budget

Use candidate_ideas, variant_spec, research_lookup, idea_policy, idea_generation, source_constraints, feasibility_policy, baseline_gate, and execution_policy as optional guidance, not as fields the agent must fill for every campaign. See references/research-campaign-spec.md for the advanced schema and artifact expectations.

Reference Loading

  • Load references/ai-research-explore-policy.md for lane safety and candidate semantics.
  • Load references/research-campaign-spec.md only when a campaign file is present or the user asks for Rigor Explore campaign governance.
  • Load ../../references/explore-variant-spec.md for run-level variant matrix details.
  • Load ../../references/research-rigor-principles.md before making novelty, contribution, SOTA, or comparability statements.
  • Load ../../references/deep-learning-experiment-principles.md when training, evaluation, baseline, ablation, metric, checkpoint, or dataset details matter.
  • Use scripts/orchestrate_explore.py and scripts/write_outputs.py for the existing deterministic artifact workflow.