← ClaudeAtlas

flip-the-scriptlisted

Use when about to assert a fact that has an exact external answer and the answer came from memory rather than a checked source — a library/API version or signature, a current-state or "latest/recommended" claim, an exact number/price/stat/date, a niche or long-tail detail, or a "yes that works / I already checked" you cannot point to evidence for. Also use whenever you notice felt-certainty standing in for a source, or you are about to declare something fixed/done/correct without a re-run. The move: treat unverified recall as stale + overconfident by default, classify whether the claim is in a reliable or unreliable recall domain, and route the unreliable ones to EXTERNAL ground truth (read-the-damn-docs, search, read the source, measure, or a fresh-context check) before asserting — not to internal second-guessing. Reach for it by default before any version/API/current-state/exact claim; skip it for stable well-known facts and settled, already-verified things (re-litigating those is its own failure mode).
88plug/flip-the-script · ★ 0 · AI & Automation · score 60
Install: claude install-skill 88plug/flip-the-script
# Flip The Script The default posture is inverted: **assume your own unverified recall is wrong until an external source says otherwise.** Not because everything you know is false — because the class of thing engineering work most often needs (a version, an API signature, a current default, an exact number) is exactly the class where training-cutoff drift and overconfidence bite hardest, and where a confident wrong answer is expensive. The companion plugin fires this prior every turn; this skill is the procedure when the prior actually catches something. **The whole point — read this first, it is measured.** Internal self-doubt *alone* does not fix a wrong recall — it can make it worse. Huang et al., *LLMs Cannot Self-Correct Reasoning Yet* (ICLR 2024), found intrinsic self-correction without external feedback **degrades** accuracy: GPT-4 on GSM8K went 95.5 → 91.5 → 89.0% over two "reconsider" rounds — but rose to 97.5% with *external/oracle* feedback. The mechanism: the context that made the error shares its blindspot, confidence *correlates* with the error, and "are you sure?" biases toward changing already-correct answers. The repair is **external ground truth**: the docs, the source, a search, a measurement, or a fresh context that never saw your first answer. Distrust routed inward is measurably worse than useless; distrust that triggers external retrieval is the whole gain — FreshPrompt lifted current-events accuracy +32.6–49.0%, and grounded error is 1.8–5% vs >60% c