← ClaudeAtlas

crucible-auditlisted

Forensic test-quality audit that detects test fraud — hollow assertions, coverage-omit gaming, mock proliferation, dead/gated tests, untested entry points, and README badge inflation that produce false green signals. Use when asked to "run a CRUCIBLE audit", "check/audit test quality", "find silent failures", "find hollow tests", "audit assertions/mocks/coverage config", "why do tests pass but nothing works", or before any release gate (pre-publish/pre-deploy) when a high test count or coverage % needs verifying against reality.
nxtg-ai/forge-plugin · ★ 5 · AI & Automation · score 73
Install: claude install-skill nxtg-ai/forge-plugin
# CRUCIBLE Test Quality Audit ## Overview The CRUCIBLE Audit skill provides the methodology for forensic analysis of test suites. It detects **test fraud** — the pattern where test count and coverage numbers look healthy but the tests prove nothing about whether the software actually works. **Origin**: Wolf's forensic audit of Podcast-Pipeline (2026-03-07). 1,601 tests, 77% claimed coverage — actual coverage ~15%, nothing worked when a human used it. ## Language Matrix (read this BEFORE running any detection command) The detection greps below are **Python/pytest-shaped** (`tests/`, `def test_`, `assert x is not None`). Run them unchanged against a JS/TS or Rust repo and every pattern returns **0 → a false CLEAN verdict**. Always translate to the stack first. NXTG-Forge's own three repos are all non-Python. | Ecosystem | Test dirs / files | Test decl | Hollow-assertion tells | Mock tells | Coverage config | |-----------|-------------------|-----------|------------------------|------------|-----------------| | Python / pytest | `tests/`, `test_*.py` | `def test_` | `assert x is not None`, `.exists()`, `assert True`, `len >= 0/1`, `isinstance` | `@patch`, `MagicMock`, `Mock()` | `[tool.coverage.run] omit`, `.coveragerc` | | Node / vitest / jest | `tests/`, `__tests__/`, `*.test.{mjs,ts,tsx}` | `it(`, `test(` | `toBeDefined`, `toBeTruthy`, `not.toBeNull`, `expect(x).toBeDefined()` | `vi.mock`, `jest.mock`, `vi.fn()` | `coverage.exclude`, `coveragePathIgnorePatterns`, `colle