research-criticlisted

Use AT EVERY RESEARCH STEP (hypothesis design, experiment setup, result interpretation, conclusion writing) to challenge soundness BEFORE committing the step. Catches confirmation bias, p-hacking, leakage, weak baselines, ungrounded claims, ad-hoc thresholds, survivorship bias. Apply automatically whenever about to write a paper claim, design an ablation, interpret a number, or update a results doc. Pairs with code-verifier (which audits artifact authenticity).
jajupmochi/claude-config · ★ 0 · Code & Development · score 72

Install: claude install-skill jajupmochi/claude-config

# /research-critic Adversarial review of the inferential chain BEFORE a claim is published. ## Master TOC - [Core principle](#core-principle) - [When to invoke](#when-to-invoke) - [The Six-Question Audit](#the-six-question-audit) - [Anti-bias checklist](#anti-bias-checklist) - [Output format when critic flags an issue](#output-format-when-critic-flags-an-issue) - [Quick check (single line)](#quick-check-single-line) - [Anti-rationalisation](#anti-rationalisation) - [Companion](#companion) ## Core principle A real experiment can still be *interpreted* wrongly. Numbers don't speak for themselves — they require a chain of inference from {data, method, comparison} to {claim}. **Each link is a place to lie to yourself.** This skill challenges each link adversarially before the claim is published. ## When to invoke Before ANY of: - Writing a result line in a paper draft / RESULTS.md - Closing an experiment ticket as "done" - Adding a number to a table or figure - Saying "our method beats X" or "our method matches Y" - Concluding from an ablation - Committing a "headline" milestone in git - Sharing results with a collaborator / advisor ## The Six-Question Audit Run all six. Each `NO` answer is a STOP — fix before claiming. ### Q1. Is the hypothesis falsifiable? | Sufficient | Insufficient | |---|---| | "Method X lifts metric Y by ≥ Z pp over baseline on dataset D, N folds" | "Method X improves Y" (improves how? on what?) | | "Coverage matches target 1−α within Δ across α