← ClaudeAtlas

research-looplisted

Run autonomous, metric-driven experiments on a version-controlled implementation against a fixed trusted evaluation harness. Use when the user asks to improve eval pass rate, benchmark score, prompt or policy quality, performance, cost, or another measurable outcome through repeated hypothesis, change, evaluate, and keep-or-discard cycles. Protect generalization with holdout gates, immutable evidence provenance, and replay-safe recovery. Reject hardcoded cases, benchmark leakage, scenario-specific patches, and harness gaming. Do not use for one-off debugging, ordinary test fixing, or Agent Skill artifact optimization.
Emlembow/skills · ★ 2 · AI & Automation · score 73
Install: claude install-skill Emlembow/skills
# Research Loop Improve the user-selected implementation through controlled experiments. Treat evaluator integrity, comparable measurements, immutable evidence identity, recoverable changes, and an auditable decision trail as hard requirements. Before creating or resuming run state, read [references/run-state-protocol.md](references/run-state-protocol.md). It defines the canonical artifacts, identifiers, lifecycle, evidence schema, and atomic completion boundary. Use [scripts/validate_run_state.py](scripts/validate_run_state.py) at every resume and completion boundary. The validator proves structural integrity, not scientific merit; independently apply the sealed acceptance rule before recording `decided`. ## Preflight the workspace Inspect the repository, harness, documentation, and Git state before writing files or asking questions. - Require a Git repository and recoverable baseline commit. Do not proceed in an unversioned workspace. - Identify pre-existing changes. If they overlap the writable scope, stop and ask the user to resolve or relocate them. If unrelated, create a branch-backed worktree without altering the original worktree. - Infer the evaluation command, metric, mutable and immutable paths, constraints, generated state, environment, and expected resource use from repository sources when possible. - Reject a request whose purpose is to improve the score by changing tests, fixtures, scoring logic, evaluation data, or protected feedback. Treat any candidate