ai-research-explore
lllllllama/rigorpilot-skills
Auditable deep learning research exploration with idea gating, fair comparison, and governed experiments.
What is ai-research-explore?
Rigor Explore compatible skill for candidate-only exploration on top of a durable research anchor. Use when you have chosen task family, dataset, benchmark, evaluation method, and SOTA references, and want to systematically explore variants with scientific rigor, reproducibility, and auditable collaboration.
- Understand repository structure and freeze task/dataset/evaluation/budget before exploration
- Gate and rank candidate ideas with explicit scoring and feasibility assessment
- Execute one bounded candidate change at a time with smoke-checking and evidence collection
- Rank candidates against current anchor using real metrics and reproducibility notes
- Write candidate outputs to explore_outputs/ with SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md
- Preserve researcher-provided ideas and optionally add small bounded set of seed ideas
How to install ai-research-explore
npx skills add https://github.com/lllllllama/rigorpilot-skills --skill ai-research-explore- Explicit exploration authorization (candidate-only work, isolated branch, or sweep)
- Durable current_research context (branch, commit, checkpoint, or trained model state)
- Frozen task family, dataset, benchmark, and evaluation method
- SOTA references and compute budget defined
How to use ai-research-explore
- 1.Confirm current_research anchor and exploration authorization with the researcher
- 2.Freeze task, dataset, benchmark, evaluation source, and SOTA reference for the campaign
- 3.Build repo-understanding artifacts needed for the campaign (via analyze-project if needed)
- 4.Preserve researcher-provided ideas and optionally add bounded seed ideas
- 5.Prioritize candidates by expected gain, cost, success likelihood, and rollback ease
- 6.Execute one clear candidate at a time using explore-code or explore-run
- 7.Collect real evidence: command status, metrics, artifacts, and reproducibility notes
- 8.Rank candidates against anchor and write outputs to explore_outputs/ with scientific metadata
Use cases
- Explore architectural variants on a fixed benchmark with fair comparison metrics
- Run hyperparameter sweeps on a frozen dataset and evaluation protocol
- Test multiple loss functions or regularization approaches against a stable baseline
- Investigate ablations of model components with auditable evidence collection
- Rank candidate improvements before committing to full reproduction or publication
- Deep learning researchers conducting systematic exploration
- Teams needing auditable candidate evaluation before claiming novelty
- Researchers with a durable current_research anchor (branch, checkpoint, or trained model)
- Scientists requiring reproducible comparison boundaries and scientific changelogs
ai-research-explore FAQ
Use ai-research-explore for full campaign management with idea gating, ranking, and scientific rigor. Use explore-code for narrow code-only adaptation and explore-run for short-cycle trials or sweeps without full campaign governance.
Minimal core: current_research, task_family, dataset, benchmark, evaluation_source, sota_reference, and compute_budget. Optional guidance: candidate_ideas, variant_spec, research_lookup, idea_policy, and execution_policy.
Freeze evaluation source and SOTA reference for the campaign, rank by real evidence first, include SCIENTIFIC_CHANGELOG.md and COMPARABILITY_REPORT.md, and never present exploratory gains as trusted reproduction success.
Write candidate-only outputs to analysis_outputs/, sources/, and explore_outputs/. Always include SCIENTIFIC_CHANGELOG.md for scientific meaning and COMPARABILITY_REPORT.md for comparison boundaries.
Stop when ideas are too close to distinguish, implementation cannot be decomposed into auditable units, blockers emerge, scientific meaning is unclear, budget is exhausted, or evaluation anchor is missing.
Full instructions (SKILL.md)
Source of truth, from lllllllama/rigorpilot-skills.
name: ai-research-explore
description: Rigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates. Use when the researcher has chosen the task family, dataset, benchmark, evaluation method, provided SOTA references, and wants candidate-only exploration on top of current_research with auditable repo understanding, idea gating, fair comparison, and governed experiments written to explore_outputs/. Do not use for README-first trusted reproduction, open-ended direction finding, narrow code-only or run-only exploration, passive repo analysis, verified novelty claims, or implicit experimentation.
ai-research-explore
Purpose
Use this as the Rigor Explore compatible skill slug after the researcher
explicitly authorizes candidate-only work on top of a durable
current_research anchor. The installed slug remains ai-research-explore for
compatibility. Rigor Explore is for meaningful and potentially novel deep
learning research candidates while preserving scientific rigor, comparability,
reproducibility, and auditable collaboration. Novelty and significance remain
hypotheses before literature contrast, ablation evidence, and fair comparison.
The skill does not promise autonomous discovery, global benchmark completeness,
novelty proof, or trusted reproduction success.
Start from the shared operating principles in
../../references/agent-operating-principles.md, then load
../../references/research-rigor-principles.md for research claims and
../../references/deep-learning-experiment-principles.md when experiment
details affect comparability or reproducibility.
Fit
Use this skill only when the request has both:
- Explicit exploration authorization such as candidate-only work, isolated branch or worktree, sweep, several variants, or exploratory ranking.
- A durable
current_researchcontext such as a branch, commit, checkpoint, run record, or already-trained local model state.
Keep narrow code-only requests on explore-code. Keep narrow run-only requests
on explore-run. Keep passive repository analysis on analyze-project. Keep
README-first reproduction on ai-research-reproduction.
Research Rhythm
Use a two-loop rhythm:
- Outer loop: understand the repository, freeze task/dataset/evaluation/budget, preserve user ideas, map sources, gate ideas, and decide whether the next experiment is worth running.
- Inner loop: make one bounded candidate change or run, smoke-check it, collect evidence, rank it against the current anchor, and either stop or return to the outer loop with the new evidence.
This rhythm is a guide, not a rigid autonomous loop. Stop at explicit blockers, unclear scientific meaning, exhausted budget, missing anchor/evaluation, or a human checkpoint.
Workflow
- Confirm
current_researchand explicit explore-lane authorization. - Accept either legacy
variant_specor higher-levelresearch_campaign. - In campaign mode, freeze the task, dataset, benchmark, evaluation source, SOTA reference, and budget before candidate work.
- Build only the repo-understanding artifacts needed for the current campaign,
usually through
analyze-project. - Run bounded, cache-first source lookup when source support matters; prefer local curated literature such as Zotero if available, then seed sources, repo-local locators, public locators, or optional web lookup. Treat lookup as source resolution, not an open-ended literature search.
- Preserve researcher-provided ideas, optionally add a small bounded set of single-variable seed ideas, and rank ideas with explicit gates and score breakdowns.
- Prefer one clear candidate at a time. Use
explore-codefor bounded code adaptation andexplore-runfor short-cycle trials or sweeps. - Use
minimal-run-and-auditorrun-trainonly when the exploratory plan requires real execution evidence. - Write candidate-only outputs to
analysis_outputs/,sources/, andexplore_outputs/as appropriate; never present exploratory gains as trusted reproduction success. IncludeSCIENTIFIC_CHANGELOG.mdandCOMPARABILITY_REPORT.mdfor candidate scientific meaning and comparison boundaries.
Ranking and Evidence
- Before execution, prioritize candidates by expected gain, cost, success likelihood, patch surface, dependency drag, evaluation risk, and rollback ease.
- After execution, rank by real evidence first: command status, observed metrics, artifacts, changed paths, smoke results, and reproducibility notes.
- Keep researcher-provided
evaluation_sourceandsota_referencefrozen for the campaign; do not claim they are globally complete. - If the top ideas are too close or the implementation cannot be decomposed into auditable units, stop for a checkpoint instead of silently choosing.
Campaign Inputs
research_campaign is preferred for Rigor Explore campaigns, but it should
stay minimal. The durable core is:
current_researchtask_familydatasetbenchmarkevaluation_sourcesota_referencecompute_budget
Use candidate_ideas, variant_spec, research_lookup, idea_policy,
idea_generation, source_constraints, feasibility_policy, baseline_gate,
and execution_policy as optional guidance, not as fields the agent must fill
for every campaign. See references/research-campaign-spec.md for the advanced
schema and artifact expectations.
Reference Loading
- Load
references/ai-research-explore-policy.mdfor lane safety and candidate semantics. - Load
references/research-campaign-spec.mdonly when a campaign file is present or the user asks for Rigor Explore campaign governance. - Load
../../references/explore-variant-spec.mdfor run-level variant matrix details. - Load
../../references/research-rigor-principles.mdbefore making novelty, contribution, SOTA, or comparability statements. - Load
../../references/deep-learning-experiment-principles.mdwhen training, evaluation, baseline, ablation, metric, checkpoint, or dataset details matter. - Use
scripts/orchestrate_explore.pyandscripts/write_outputs.pyfor the existing deterministic artifact workflow.
Related skills
More from lllllllama/rigorpilot-skills and the wider catalog.
analyze-project
Read-only analysis of deep learning repositories to understand structure, configs, and suspicious patterns.
explore-code
Auditable exploratory code modifications for deep learning research on isolated branches with rollback tracking.
ai-research-reproduction
README-first deep learning repository reproduction with auditable evidence and standardized outputs.
paper-context-resolver
Resolve reproduction-critical paper details when README and repo files leave gaps.
safe-debug
Conservative diagnosis and minimal patching for deep learning training failures without automatic code mutation.
run-train
Execute and document deep learning training runs with reproducibility and status tracking.