tutti-test-audit

Featured

Audit, design, write, materially revise, or remove Tutti tests. Use whenever Codex changes or reviews unit, component, conformance, integration, regression, platform, or repository tests; enforce a protected product contract, credible failure, correct owning boundary, negative-control evidence, overlap review, deterministic setup, and an executing CI lane.

AI & Automation 3,715 stars 375 forks Updated 6 days ago Apache-2.0

Install

View on GitHub

Quality Score: 90/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Tutti Test Audit Make every changed test earn its maintenance cost. A green test, a coverage increase, or a larger test count is not a quality verdict. Read the root and closest scoped `AGENTS.md`, then read `docs/conventions/unit-testing.md` before a non-trivial test change or review. Follow `docs/conventions/testing.md#validation-selection` for commands and validation scope. ## Establish the evidence map Before editing, inspect: 1. the production owner, public entry point, relevant caller and callee; 2. sibling implementations that share the same invariant; 3. existing tests, fixtures, conformance suites, and repository checks; 4. the changed-aware and platform lane that will select the evidence; 5. relevant history for a regression or a suspicious existing test. For Agent Host lifecycle semantics, also read `packages/agent/host/README.md` and start with the conformance contract. Do not reimplement lifecycle tests in an adapter. ## Pass the authoring gate Answer all six questions before adding or materially rewriting a test: 1. **Protected contract:** What observable behavior, invariant, compatibility promise, or prior failure matters? 2. **Credible failure:** What plausible faulty implementation must make the test fail? 3. **Coverage gap:** Why would existing evidence not catch that failure? Can an existing table, scenario, or fixture express it without duplication? 4. **Owner and observer:** Which module owns the decision, and what is the lowest bou...

Details

Author
tutti-os
Repository
tutti-os/tutti
Created
3 months ago
Last Updated
6 days ago
Language
TypeScript
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category

Testing & QA Listed

test-audit

Audit test files against the project's AGENTS.md test conventions, ensuring tests meet the bar for high-quality behavioral specs. Also checks whether production code changes have adequate test coverage (coverage gap analysis). Use when asked to "audit tests", "check test quality", "review tests against AGENTS.md", "do a test pass", "check test conventions", "ensure tests are high quality", or "are there missing tests". Focuses on test design, assertion quality, and coverage gaps — not code coverage metrics. NOT for: production code quality (use code-quality) or full PR review (use pr-review).

0 Updated today
aliasunder
AI & Automation Listed

agent-testability

Audit whether a codebase gives a coding agent a reliable way to verify its own work, and propose fixes. Use whenever an agent reports success but the change is broken, when tests exist but don't catch regressions, when the feedback loop is too slow or too noisy for an agent to use, when test failures don't say what broke, or when someone asks how to make a repo safe for autonomous or unattended agent runs. Also use for requests like "why does it keep saying it's done when it isn't", "review our test setup for agents", "what should agents run before opening a PR", or planning a testing strategy where the consumer is an agent rather than a human.

0 Updated 1 weeks ago
arndvs
AI & Automation Listed

ai-agents-validation-and-qa

What counts as evidence in ai-agents and how to produce it. Covers the TESTING-RIGOR pos+neg+edge bar, test layout and collection reality, coverage proof commands, runtime-contract tests with negative controls, and ADR-034 QA skip semantics at session end. Use when you say `what counts as evidence`, `how do I test this change`, `run skill tests`, `can I skip QA`. Do NOT use for CI failure triage (use `ai-agents-debugging-playbook`) or measurement tooling (use `ai-agents-diagnostics-toolkit`).

45 Updated today
rjmurillo