skill-auditor

Featured

Audit a SKILL.md or REFERENCE file, score it 0–10, identify major and minor findings, and generate copy-paste improvements. Use when reviewing a new skill before merging, auditing an existing skill for gaps, checking cross-skill consistency, or validating that a skill meets the Quality-Engineering-Skills framework standards. Triggers: audit this skill, score this SKILL.md, review reference file, check skill quality, find gaps in skill, validate skill before PR.

AI & Automation 36 stars 16 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 88/100

Stars 20%
52
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Skill Auditor Agent ## Role You are a Quality Engineering Skills Auditor. Your job is to audit SKILL.md and REFERENCE files against the Quality-Engineering-Skills framework standards, score them objectively, and generate actionable improvement patches. You audit with the mindset of a senior quality engineer reviewing a work instruction before it goes into production: it must be clear, complete, evidence-based, and executable without interpretation. --- ## Output Format Ask once at the start of the session: > "How would you like to receive the audit output? > **A** — Structured Markdown (formatted report with tables, ready to paste into GitHub PR) > **B** — Plain text (simplified for copy into Word or email) > **C** — Patch only (copy-paste improvements only, no commentary) > > Default: A." Apply the chosen format to all outputs generated during the session. --- ## How to run When the user invokes this agent: 1. Ask: "Paste the SKILL.md or REFERENCE file content, or provide the file path." 2. Identify whether it is a SKILL.md (executable skill) or a REFERENCE file (explanatory reference). 3. Run the appropriate audit (see below). 4. Generate the full audit report. If the user pastes multiple files, audit each separately then run cross-skill consistency check. --- ## LEVEL 1 — SKILL.md Audit ### Scoring model | Dimension | Max | What to evaluate | |-----------|-----|-----------------| | Structure | 2 | Frontmatter complete, required sections present | | Execut...

Details

Author
RBraga01
Repository
RBraga01/Quality-Engineering-Skills
Created
3 months ago
Last Updated
yesterday
Language
JavaScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

skill-auditor

Audit an Agent Skill or a repository of skills for trigger quality, scope overlap, instruction conflicts, progressive-disclosure cost, broken references/dependencies, eval blind spots, false-green paths, semantic-version and public-contract compatibility, host-support overclaims, package hygiene, supply-chain risks, migration/deprecation gaps, and drift between registry, docs, tests, and shipped archives. Use when the user asks to audit, review, roast, harden, compare, or quality-check a skill or skill library itself. Do not use to create/edit the skill (use skill-creator), to empirically benchmark model behavior with-vs-without it (use skill-evaluator), to audit ordinary software (use repo-roaster), or to issue a production release verdict.

1 Updated today
CometWeb-io
AI & Automation Listed

skill-quality-auditor

Evaluate, score, and remediate agent skill collections using a 9-dimension quality framework (Knowledge Delta, Mindset, Anti-Patterns, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, Practical Usability, Eval Validation). Performs duplication detection, generates remediation plans with T-shirt sizing, enforces CI quality gates, validates artifact conventions, tracks score trends, and provides a native eval runner with LLM-as-judge (BYOK, provider-agnostic). Use when evaluating skill quality, auditing SKILL.md files, scoring agent skills, generating remediation plans, detecting duplicate skills, validating skill format, enforcing quality gates, optimizing for A-grade publication, comparing audit baselines, batch skill assessments, or checking skill registry compliance. Triggers: 'check my skills', 'skill audit', 'improve my SKILL.md', 'quality check', 'A-grade scoring', 'quality gates', 'eval validation', 'audit all skills', 'remediation plan', 'skill judge', 'dimens

2 Updated 1 weeks ago
pantheon-org
AI & Automation Listed

skill-auditor

Reviews a Claude Skill before it ships and returns concrete revision recommendations. Audits eight dimensions — leaked credentials, triggering reliability, dependency path pinning, scope boundaries, gap-finding, prompt depth, writing standards, and leanness (dead weight, layering, token cost). Use whenever a SKILL.md is written, edited, slimmed, or about to be packaged, even if no review was requested; when a skill runs unreliably - drifting off its workflow, skipping steps or dependencies, faking success, stopping mid-task, forgetting API details, or taking a different path each run; when a skill fails to trigger, feels bloated or too long, or its token cost needs cutting; or for help with skill structure and best practices.

0 Updated 1 months ago
jameswu881102