← ClaudeAtlas

neuroscience-stratify-and-report-detection-metricslisted

Use at analysis when a detection or classification result is about to be reported as one accuracy over a pooled population. Covers per-group and per-class precision, recall and confusion matrices at a stated threshold, and sweeping the degradations the recording modality actually suffers.
tangxiangru/AutoR · ★ 805 · AI & Automation · score 79
Install: claude install-skill tangxiangru/AutoR
# Report per-group and per-class detection metrics, and sweep the modality's own degradations Neuroscience data arrives with grouping factors, and the field reports per group. Before analysing, list every categorical in the design or the file that is not the label - experimental condition, subject or session, region, cell type, acquisition site, artifact class - and make each one a reporting axis. Every headline number is reported per level, with the pooled value as one additional row. A column present in the data but absent from your tables reads as an unreported factor. Events of interest are usually rare, so use the detection metric family rather than accuracy or AUROC: precision, recall and F1 at a stated operating threshold, a precision-recall curve with average precision, and a confusion matrix - per class and per stratum. AUROC is insensitive to the prevalence regime the science operates in; report it only alongside these. Robustness means the corruptions the instrument itself produces - motion, drift, channel or electrode loss, line noise, low SNR, downsampling, session-to-session shift - swept one at a time, each as a degradation curve of the same metric, with the comparison methods on the same axes so relative decay rates are visible. Generic added Gaussian noise does not test this. Open with provenance: source dataset, acquisition modality, physical extent (volume, duration, subjects, cells), how ground-truth labels were obtained, and how it compares in scale a