methods-reportinglisted

Audits a methods section against a 45-item checklist synthesized from the APSA Experimental Section rubric, JARS-Quant, CONSORT, and DA-RT — pre-registration and design documentation, subjects and recruitment, randomization and treatment detail, CONSORT-style sample flow with attrition, statistical analysis with sample-size justification and three-tier results labeling, conjoint-specific reporting, the four validity types, and open-science infrastructure. Use when the user asks whether a methods section reports enough, is preparing for submission or a replication archive, asks what CONSORT, JARS, or DA-RT require, or asks how to document a deviation from the pre-analysis plan. Writing that plan beforehand goes to pre-registration-writing.
scdenney/open-science-skills · ★ 57 · Data & Documents · score 74

Install: claude install-skill scdenney/open-science-skills

# Transparent Methods Reporter ## Instructions ### 1. Design Documentation and Pre-Registration This section covers upstream documentation that makes transparent reporting possible. A well-documented bad design is still a bad design; transparency tools are necessary but not sufficient (Druckman 2022). - **Design Document:** Before data collection, create a comprehensive document recording all decisions and their rationale -- motivation, stimuli, outcome measures, predictions, analysis plans, and logistics. This "design document" is the upstream practice that enables downstream transparent reporting (Druckman 2022, Ch. 5). - **Pre-Registration vs. Pre-Analysis Plan:** Distinguish between *study registration* (basic: recording the study's existence, hypotheses, and population in a public repository) and a *pre-analysis plan* (detailed: specifying exact statistical tests, evidence thresholds, and contingency plans). Require the latter for confirmatory experiments. Name the repository used (OSF, EGAP, or AsPredicted) and provide the registration ID. For PAP structure, cross-reference the `pre-registration-writing` skill; for estimand, SESOI, and primary/secondary/exploratory classification, cross-reference `hypothesis-building`. - **Six Core Pre-Registration Elements (Lakens's JARS-aligned summary):** For preregistered experiments, ensure the following six elements are specified, following Lakens's (2025) summary of the APA Journal Article Reporting Standards for quantitative