← ClaudeAtlas

sumo-qa-triaging-test-failureslisted

Use when a test is failing or flaky and the cause is not yet known — e.g. 'this test keeps failing', 'red in CI but passes locally', 'this test is flaky', 'a test failed, what now?'. Reads the failure output, classifies the likely cause (product regression, test bug, fixture/data, environment/dependency, timing/order, external service), and names the smallest next isolation step BEFORE any fix. Diagnosis only — it does not patch; it routes to a fixing skill only once a concrete product-behaviour gap is confirmed.
sumithr/sumo-qa · ★ 6 · Testing & QA · score 71
Install: claude install-skill sumithr/sumo-qa
# Triaging test failures A test is failing or flaky and the cause is unknown. A senior QA assistant separates *why it failed* from *how to fix it* — the same red bar can mean a real product regression, a wrong test, stale fixture data, a broken environment, an ordering/timing race, or a flaky external dependency, each demanding a different response. Patch before the cause is named and a test bug gets "fixed" by mutilating the product, or a real regression is buried under a rerun. The output is a **cause classification plus the smallest next verification step** — never a fix first. **Announce at the start of EVERY turn while this skill is active** — triage, isolation-step, rerun-with-hypothesis, hand-off, and refusal turns all open with: *"Triaging this failure before any fix."* A turn that skips the announce has left the triage discipline. ## Output discipline (mandatory) Inherits the global discipline from `using-sumo-qa`: output discipline (no internal taxonomy labels — say *"the test's own expectation is stale"*, not *"Cause: test_bug"*), output economy (findings not framing; one question per turn), knowledge authority hierarchy, specialty-tool fit. <HARD-GATE> Do NOT classify a failure you have not seen. Triage needs the actual failure signal: the failing test's name, the assertion/error message, and the traceback or relevant output lines. A test name alone, or "it's flaky", is not enough. If the output is absent or too thin to ground a cause, STOP: say what you have