night-market-validation-and-qa

Featured

Enforce evidence bar, coverage gates, and regression guards. Use when adding tests or claiming done. Do not use to run suites; use night-market-operations.

Testing & QA 337 stars 34 forks Updated today MIT

Install

View on GitHub

Quality Score: 88/100

Stars 20%
84
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Validation and QA: what counts as evidence here This skill defines the evidence bar for claiming work complete, the coverage and quality thresholds that gate merges, the golden regression tests that guard settled battles, and the procedure for adding tests. The one-line thesis: a green check proves spec-satisfaction, not correctness, so every completion claim needs cited evidence and every test needs proof it can fail. ## The evidence bar Never claim "should work". Run the thing, capture the output, cite it. The house discipline comes from `Skill(imbue:proof-of-work)`: 1. Number every piece of evidence: `[E1]`, `[E2]`, each with the exact command and its captured output. 2. Map each acceptance criterion to evidence with a verdict: `Criterion: [E2] -> PASS` or `-> FAIL`. 3. Give the overall claim one of three statuses: `COMPLETE` (all criteria passed), `PARTIAL` (list blockers), `BLOCKED` (explain why). A blocked task reported as blocked with evidence is a successful report. A guessed "done" is not. 4. The final response must not contain "should work", "looks right", or any other unverified confidence phrase. ### Verifier integrity: never let the generator judge itself A passing verifier can mislead two ways (from the prover-verifier research, codified in commit `29081fda`, module `plugins/imbue/skills/proof-of-work/modules/verifier-integrity.md`): | Failure mode | What it looks like | |--------------|--------------------| | Wrong spec | The check co...

Details

Author
athola
Repository
athola/claude-night-market
Created
9 months ago
Last Updated
today
Language
Python
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

ai-agents-validation-and-qa

What counts as evidence in ai-agents and how to produce it. Covers the TESTING-RIGOR pos+neg+edge bar, test layout and collection reality, coverage proof commands, runtime-contract tests with negative controls, and ADR-034 QA skip semantics at session end. Use when you say `what counts as evidence`, `how do I test this change`, `run skill tests`, `can I skip QA`. Do NOT use for CI failure triage (use `ai-agents-debugging-playbook`) or measurement tooling (use `ai-agents-diagnostics-toolkit`).

45 Updated today
rjmurillo
AI & Automation Listed

verification-evidence

Use before claiming any work state – done, fixed, passing, green, complete, mergeable – and whenever a required or cited check times out, is unexpectedly expensive, or needs a retry. Defines the identify-run-read-verify gate, timeout evidence and retry records, and the baseline/lane-final/integrated/post-merge verification topology with evidence-identity and reuse rules.

2 Updated 1 weeks ago
bartoszarendt
AI & Automation Listed

core-evidence-based-qa

Evidence-based quality assurance doctrine for {{PROJECT_NAME}}. Teaches the reasoning behind test-signal discipline — when a defect may be declared fixed, how to interpret coverage numbers without coverage-washing, why mutation score outranks line coverage as a quality signal, and how to produce reviewer-trusted sign-offs that cite verifiable evidence rather than assertions. Use when performing QA review, classifying regressions, evaluating test quality, interpreting CI output, or any time an agent claims "tests pass" or "bug fixed" and must back that claim.

2 Updated today
Canhada-Labs