edit-manifest

Solid

Implements a predict-verify loop for harness edits. Every SKILL.md, rules/*.md, or CLAUDE.md change is paired with a predicted impact stored in a manifest. The next session verifies predictions against actual outcomes, and a validation gate accepts edits only when improvement is measurable. Runs automatically on harvest-loop Step 0-c and on explicit invocation.

AI & Automation 8 stars 0 forks Updated today MIT

Install

View on GitHub

Quality Score: 79/100

Stars 20%
32
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# edit-manifest — Predict-Verify Loop for Harness Edits > Implements two mechanisms from frontier harness research, named as in their source papers (both terms > are the papers' own — verified 2026-06-17 against arXiv full text): > - **Change Manifest** (AHE, arXiv:2604.25850): each edit attaches a manifest entry declaring a > falsifiable predicted impact (expected fixes + at-risk regressions); the next round intersects it > with observed task-level deltas to produce a per-edit verdict. (Paper: "the Evolve Agent produces a > change manifest…".) > - **Validation Gate** (SkillOpt, arXiv:2605.23904): a candidate is accepted only when its > selection-split score is strictly greater than the current selection score (ties rejected); rejected > edits are kept in an epoch-local buffer, not silently discarded. (Paper: "validation gate" / > "held-out gate".) FH's regression_guard.sh catches backward regressions. edit-manifest closes the forward loop: did the edit actually improve what it claimed to improve? **Boundary vs. verify-bidirectional**: verify-bidirectional is *reactive* — it updates the baseline when the user raises a counter-argument to an AI recommendation. edit-manifest is *predictive* — it records a forward prediction at edit time and verifies it against outcomes later, with no user counter-argument required. Different axes: one responds to challenge, the other tests a self-declared hypothesis. ## Manifest File Location ``` tracks/_meta/edit_manifest.yaml...

Details

Author
chrono-meta
Repository
chrono-meta/forge-harness
Created
2 months ago
Last Updated
today
Language
Shell
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category