← ClaudeAtlas

agent-failure-diagnosislisted

Diagnose why an AI agent behaved badly, using operationalised criteria that two independent reviewers can apply to the same evidence and reach the same answer. Use this whenever someone describes an agent that misbehaved, went off track, did something unexpected, ignored instructions, made things up, went beyond its scope, got stuck in a loop, lied about what it did, or "went rogue" — and whenever reviewing agent traces, logs, or transcripts to work out what went wrong. Use it for post-incident analysis, for design reviews asking "how could this fail?", and when someone needs to classify agent failures consistently enough to spot patterns across many incidents. Reach for this even when the user just wants an explanation rather than a formal report, because the classification is what makes the explanation defensible later.
PKusch/remit · ★ 0 · AI & Automation · score 72
Install: claude install-skill PKusch/remit
# Diagnosing agent failure Two reviewers looking at the same failed run routinely reach different conclusions — one says hallucination, another says injection, a third says it went rogue. The incident log then records vocabulary instead of observations, and no pattern is ever visible across incidents. This skill applies the criteria in [`framework/diagnostic-manual.md`](../../framework/diagnostic-manual.md) — read it before diagnosing, and work from the criteria rather than from memory. Six classes: **G** goal, **P** perception, **A** action, **M** memory, **S** social, **R** self-report. ## The one rule that governs everything else **Diagnose from artefacts, never from narrative.** The trace, the tool-call log, the inputs, the outputs, the permission set at the time of action. Not the user's summary of what happened, and above all not the agent's own account — an agent's explanation of its behaviour is evidence about `R1 post-hoc rationalisation` and is inadmissible for everything else. Where self-report and trace conflict, the trace wins, without exception. If someone hands you only a narrative, say what evidence you need before you can classify, and offer a provisional differential in the meantime — clearly labelled as provisional. ## Procedure ### 1. Collect Ask for whatever exists: execution trace, tool-call log, the actual inputs (including any retrieved content), the outputs, memory state before and after, and the permissions the agent held at the time. Note wh