evidence-assessment

# Evidence Assessment Valid reasoning from false premises proves nothing. Evidence assessment is the discipline of testing whether the premises of an argument are actually supported by the data, what kind of data would be decisive, and how much confidence the available evidence warrants. This skill covers the evaluation of sources, study designs, sampling, levels of evidence, and the integration of new evidence with prior knowledge. **Agent affinity:** elder (structural reconstruction of evidence claims), tversky (base rates, inductive strength), kahneman-ct (evidence evaluation under System 1/2) **Concept IDs:** crit-evidence-quality, crit-sourcing, crit-burden-of-proof, crit-scientific-literacy ## The Assessment Toolbox at a Glance | # | Operation | Question answered | |---|---|---| | 1 | Source identification | Where did this claim come from? | | 2 | Primary vs. secondary | Is this the original source or a report of it? | | 3 | Source credibility | Does the source have relevant expertise and a track record? | | 4 | Funding and conflicts | Who paid for this? What do they stand to gain? | | 5 | Sample quality | How were the data collected and from whom? | | 6 | Study design | Observational? Experimental? Randomized? | | 7 | Levels of evidence | Where does this study sit in the evidence hierarchy? | | 8 | Reproducibility | Has this result been replicated? | | 9 | Scope check | What does the evidence actually show vs. what is being claimed? | | 10 | Base rate integration ...