evallisted

# Eval The runner for the harness **fitness function**. It discovers `.oh/evals/probes/*.sh`, runs each against *real state*, and writes the `.oh/evals/RESULTS.md` scoreboard. A rectification is provably "done" when its probe is green; a recurrence shows up as a **REGRESSION** (was-PASS, now-fail) naming the `# source:` lesson. The full contract — 3-state exit oracle, header convention, correction-surface triage — is in [`.oh/evals/README.md`](../../../.oh/evals/README.md). ## Usage ```bash bash .claude/skills/eval/run.sh # run the whole suite, rewrite RESULTS.md bash .claude/skills/eval/run.sh --probe <id> # run one probe, update only its row bash .claude/skills/eval/run.sh --tier A # run only Tier-A probes ``` Exit-code oracle (per probe): `0`=PASS, `1`=REGRESSION, `2`=SKIPPED (not applicable — excluded from pass-rate), `124`=TIMEOUT, other=ERROR. Each probe is wrapped in `timeout 30s`. Runner aggregate exit (the process `$?` of `run.sh` itself): `0` when no new green→red regression occurred this run, `1` when one or more new regressions were detected (`${#regressions[@]} > 0`). When invoked via the Bash tool as `bash .claude/skills/eval/run.sh`, the agent caller reads `$?` directly to gate on success — the printed `REGRESSIONS (...)` stdout block and per-probe stderr lines remain the human-readable signal. Note: the `eval-weekly` cron is an intentional legacy caller that appends `|| true` then greps stdout; it does not consume the exit code by