PluginBench
Skill
Review
Audit score 70

ai-research-explore

lllllllama/rigorpilot-skills

Structured exploration of deep learning research candidates with scientific rigor, fair comparison, and auditable experiments.

What is ai-research-explore?

A skill for researchers who have fixed their task, dataset, benchmark, and evaluation method and want to systematically explore novel candidate ideas on top of a stable research anchor. Use it to gate ideas, run bounded experiments, rank results fairly, and document scientific meaning—not for open-ended direction-finding or trusted reproduction.

  • Confirm and preserve a durable `current_research` anchor (branch, commit, or checkpoint) before exploration begins
  • Gate and rank candidate ideas by expected gain, cost, success likelihood, and implementation complexity before execution
  • Run bounded, single-variable candidate changes with smoke-checking and evidence collection against the frozen anchor
  • Generate auditable artifacts including `SCIENTIFIC_CHANGELOG.md` and `COMPARABILITY_REPORT.md` to document candidate meaning and comparison boundaries
  • Integrate with `explore-code` and `explore-run` for narrower code or execution work, and `analyze-project` for repo understanding

How to install ai-research-explore

npx skills add https://github.com/lllllllama/rigorpilot-skills --skill ai-research-explore
Prerequisites
  • A durable `current_research` anchor (branch, commit, checkpoint, or trained model state)
  • Explicit authorization for candidate-only or exploratory work (not trusted reproduction)
  • Frozen task family, dataset, benchmark, evaluation method, and SOTA reference for the campaign
  • Access to `references/` documentation including research-rigor-principles.md and deep-learning-experiment-principles.md
Claude Code
Cursor
Windsurf
Cline

How to use ai-research-explore

  1. 1.Confirm your `current_research` anchor and that you are authorizing candidate-only exploration, not trusted reproduction
  2. 2.Define or load your `research_campaign` with task, dataset, benchmark, evaluation source, SOTA reference, and compute budget
  3. 3.Use `analyze-project` to build repo-understanding artifacts needed for the campaign
  4. 4.Preserve researcher-provided ideas and optionally add a small bounded set of seed ideas; gate and rank them by expected gain and feasibility
  5. 5.Select one clear candidate at a time; use `explore-code` for code adaptation or `explore-run` for short trials
  6. 6.Execute the candidate with smoke-checking and evidence collection; rank results against the frozen anchor using real metrics
  7. 7.Write outputs to `explore_outputs/`, `analysis_outputs/`, and `sources/`; include `SCIENTIFIC_CHANGELOG.md` and `COMPARABILITY_REPORT.md`
  8. 8.Return to the outer loop with new evidence or stop at explicit blockers, unclear scientific meaning, or exhausted budget

Use cases

Good for
  • Exploring architectural variants (layer depth, activation functions, normalization schemes) on a fixed benchmark while preserving reproducibility
  • Ranking multiple hyperparameter sweep candidates by real metrics before committing to a direction
  • Testing ablations of a proposed method component against a frozen baseline to isolate contribution
  • Documenting why exploratory gains do not yet constitute trusted reproduction or novelty claims
  • Comparing candidate ideas across a curated SOTA reference set with explicit evaluation boundaries
Who it's for
  • ML researchers conducting systematic ablation studies or variant exploration
  • Teams needing auditable candidate ranking before committing compute to full training runs
  • Researchers who want to separate exploratory work from trusted reproduction in version control
  • Scientists publishing deep learning work who need to document comparability and scientific meaning

ai-research-explore FAQ

When should I use ai-research-explore vs. ai-research-reproduction?

Use ai-research-explore when you are exploring novel candidate ideas on top of a fixed anchor and want to rank them fairly. Use ai-research-reproduction for README-first trusted reproduction or verifying existing claims.

What is a durable `current_research` anchor?

A branch, commit, checkpoint, run record, or already-trained local model state that serves as the stable baseline for all candidate comparisons during the campaign.

Do I need to run full training for every candidate?

No. Use `explore-run` for short-cycle trials or sweeps, and `minimal-run-and-audit` or `run-train` only when the exploratory plan requires real execution evidence. Prioritize candidates before running.

Can I claim novelty or SOTA from exploratory results?

No. Exploratory gains remain hypotheses until literature contrast, ablation evidence, and fair comparison are complete. Always document candidate meaning and comparison boundaries in `COMPARABILITY_REPORT.md`.

What if I do not have a frozen evaluation method or SOTA reference?

Do not use this skill. Use `ai-research-reproduction` for README-first work or `analyze-project` for open-ended repo analysis until your evaluation and reference are fixed.

Full instructions (SKILL.md)

Source of truth, from lllllllama/rigorpilot-skills.


name: ai-research-explore description: Rigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates. Use when the researcher has chosen the task family, dataset, benchmark, evaluation method, provided SOTA references, and wants candidate-only exploration on top of current_research with auditable repo understanding, idea gating, fair comparison, and governed experiments written to explore_outputs/. Do not use for README-first trusted reproduction, open-ended direction finding, narrow code-only or run-only exploration, passive repo analysis, verified novelty claims, or implicit experimentation.

ai-research-explore

Purpose

Use this as the Rigor Explore compatible skill slug after the researcher explicitly authorizes candidate-only work on top of a durable current_research anchor. The installed slug remains ai-research-explore for compatibility. Rigor Explore is for meaningful and potentially novel deep learning research candidates while preserving scientific rigor, comparability, reproducibility, and auditable collaboration. Novelty and significance remain hypotheses before literature contrast, ablation evidence, and fair comparison. The skill does not promise autonomous discovery, global benchmark completeness, novelty proof, or trusted reproduction success.

Start from the shared operating principles in ../ai-research-reproduction/references/agent-operating-principles.md, then load ../ai-research-reproduction/references/research-rigor-principles.md for research claims and ../ai-research-reproduction/references/deep-learning-experiment-principles.md when experiment details affect comparability or reproducibility.

Fit

Use this skill only when the request has both:

  • Explicit exploration authorization such as candidate-only work, isolated branch or worktree, sweep, several variants, or exploratory ranking.
  • A durable current_research context such as a branch, commit, checkpoint, run record, or already-trained local model state.

Keep narrow code-only requests on explore-code. Keep narrow run-only requests on explore-run. Keep passive repository analysis on analyze-project. Keep README-first reproduction on ai-research-reproduction.

Research Rhythm

Use a two-loop rhythm:

  • Outer loop: understand the repository, freeze task/dataset/evaluation/budget, preserve user ideas, map sources, gate ideas, and decide whether the next experiment is worth running.
  • Inner loop: make one bounded candidate change or run, smoke-check it, collect evidence, rank it against the current anchor, and either stop or return to the outer loop with the new evidence.

This rhythm is a guide, not a rigid autonomous loop. Stop at explicit blockers, unclear scientific meaning, exhausted budget, missing anchor/evaluation, or a human checkpoint.

Workflow

  1. Confirm current_research and explicit explore-lane authorization.
  2. Accept either legacy variant_spec or higher-level research_campaign.
  3. In campaign mode, freeze the task, dataset, benchmark, evaluation source, SOTA reference, and budget before candidate work.
  4. Build only the repo-understanding artifacts needed for the current campaign, usually through analyze-project.
  5. Run bounded, cache-first source lookup when source support matters; prefer local curated literature such as Zotero if available, then seed sources, repo-local locators, public locators, or optional web lookup. Treat lookup as source resolution, not an open-ended literature search.
  6. Preserve researcher-provided ideas, optionally add a small bounded set of single-variable seed ideas, and rank ideas with explicit gates and score breakdowns.
  7. Prefer one clear candidate at a time. Use explore-code for bounded code adaptation and explore-run for short-cycle trials or sweeps.
  8. Use minimal-run-and-audit or run-train only when the exploratory plan requires real execution evidence.
  9. Write candidate-only outputs to analysis_outputs/, sources/, and explore_outputs/ as appropriate; never present exploratory gains as trusted reproduction success. Include SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md for candidate scientific meaning and comparison boundaries.

Ranking and Evidence

  • Before execution, prioritize candidates by expected gain, cost, success likelihood, patch surface, dependency drag, evaluation risk, and rollback ease.
  • After execution, rank by real evidence first: command status, observed metrics, artifacts, changed paths, smoke results, and reproducibility notes.
  • Keep researcher-provided evaluation_source and sota_reference frozen for the campaign; do not claim they are globally complete.
  • If the top ideas are too close or the implementation cannot be decomposed into auditable units, stop for a checkpoint instead of silently choosing.

Campaign Inputs

research_campaign is preferred for Rigor Explore campaigns, but it should stay minimal. The durable core is:

  • current_research
  • task_family
  • dataset
  • benchmark
  • evaluation_source
  • sota_reference
  • compute_budget

Use candidate_ideas, variant_spec, research_lookup, idea_policy, idea_generation, source_constraints, feasibility_policy, baseline_gate, and execution_policy as optional guidance, not as fields the agent must fill for every campaign. See references/research-campaign-spec.md for the advanced schema and artifact expectations.

Reference Loading

  • Load references/ai-research-explore-policy.md for lane safety and candidate semantics.
  • Load references/research-campaign-spec.md only when a campaign file is present or the user asks for Rigor Explore campaign governance.
  • Load ../ai-research-reproduction/references/explore-variant-spec.md for run-level variant matrix details.
  • Load ../ai-research-reproduction/references/research-thinking-loop.md before proposing or ranking candidate changes; it is the required greedy observe-ground-design-compare cycle.
  • Load ../ai-research-reproduction/references/research-rigor-principles.md before making novelty, contribution, SOTA, or comparability statements.
  • Consult ~/.rigorpilot/PERSONAL_RIGOR.md if present, under ../ai-research-reproduction/references/continuous-learning-policy.md (advisory only; core wins).
  • Load ../ai-research-reproduction/references/deep-learning-experiment-principles.md when training, evaluation, baseline, ablation, metric, checkpoint, or dataset details matter.
  • Use scripts/orchestrate_explore.py and scripts/write_outputs.py for the existing deterministic artifact workflow.