scientific-validationlisted

# Scientific Validation Skill Rigorous methodology for validating claims from any source - books, papers, theories, or intuition. ## When This Skill Activates - Testing claims from books, papers, or expert sources - Validating rules, strategies, or hypotheses - Running experiments or backtests - Keywords: "validate", "test hypothesis", "experiment", "backtest", "prove", "evidence" --- ## Core Principle **Data is the arbiter. Sources can be wrong.** - Expert books can be wrong - Only empirical validation decides what works - Document negative results - they're valuable --- ## Phase Overview | Phase | Name | Key Requirement | |-------|------|-----------------| | 0 | Claim Verification | Understand what source ACTUALLY claims | | 1 | Claims Extraction | Document with source citations | | 1.5 | Publication Bias Prevention | Document ALL claims before selecting | | 2 | Pre-Registration | Hypothesis BEFORE seeing results | | 2.3 | **Power Analysis** | Calculate required n (MANDATORY) | | 3 | Bias Prevention | Look-ahead, survivorship, selection | | 3.5 | **Walk-Forward** | Required for time series (MANDATORY) | | 4 | Statistical Requirements | p-values, effect sizes, corrections | | 4.7 | Bayesian Complement | Bayes Factors for ambiguous results | | 5 | Multi-Source Validation | Test across 3+ contexts | | 5.3 | **Sensitivity Analysis** | ±20% parameter stability (MANDATORY) | | 5.5 | Adversarial Review | Invoke experiment-critic agent | | 6 | Classification | VALIDATED /