skill-optimize

Solid

Run a structured evaluate-analyze-improve cycle on any GAAI skill to measure quality, detect regressions, and propose targeted improvements. Activate when a skill needs baseline evaluation, after SKILL.md modifications, or when friction-retrospective flags a skill.

AI & Automation 155 stars 28 forks Updated 2 days ago NOASSERTION

Install

View on GitHub

Quality Score: 83/100

Stars 20%
73
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Skill Optimize ## Purpose / When to Activate Activate when: - A skill needs a baseline quality measurement (no ledger.yaml exists yet) - A SKILL.md has been modified and a before/after regression check is needed - `friction-retrospective` flags a skill as a recurring friction source - An eval cycle is needed after a manual skill update This skill formalizes the Skill Optimize protocol referenced by `eval-run` (SKILL-CRS-025). It runs the full evaluate-analyze-improve loop with mandatory human gates at every modification step. **Scope:** Any GAAI skill with measurable quality criteria — not limited to content-production skills. The inline Skill Optimize protocol in `discovery.agent.md` remains the agent's orchestration logic; this skill provides the structured execution procedure. --- ## Process ### Step 1 — Eval authoring If no `evals.yaml` exists for the target skill: 1. Read the target `SKILL.md` in full. 2. Identify measurable quality criteria from the `Quality Checks` section. 3. Author `evals.yaml` following the `evals-format.md` spec (see `eval-run/references/evals-format.md`). 4. Include a minimum of 5 assertions with a mix of `code` and `llm-judge` types. 5. Store the file at `{skill-dir}/eval-corpus/evals.yaml`. **HUMAN CHECKPOINT:** Present the drafted `evals.yaml` for validation. Do not proceed until approved. If rejected, revise based on feedback and re-present. ### Step 2 — Corpus generation If no corpus outputs exist in `{skill-dir}/eval-corpus/`: ...

Details

Author
Fr-e-d
Repository
Fr-e-d/GAAI-framework
Created
5 months ago
Last Updated
2 days ago
Language
Shell
License
NOASSERTION

Similar Skills

Semantically similar based on skill content — not just same category

Data & Documents Listed

skill-optimizer

Use when the user wants to analyze, audit, or improve their Agent Skills (SKILL.md files). Triggers on /optimize-skill, /skill-audit, 'optimize skills', 'analyze skills', 'check my skills', 'skill quality'. Also use proactively when the user mentions skills aren't triggering, skills feel broken, or asks why a skill didn't fire.

1 Updated today
Bennaco7539
AI & Automation Listed

skill-quality-auditor

Evaluate, score, and remediate agent skill collections using a 9-dimension quality framework (Knowledge Delta, Mindset, Anti-Patterns, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, Practical Usability, Eval Validation). Performs duplication detection, generates remediation plans with T-shirt sizing, enforces CI quality gates, validates artifact conventions, tracks score trends, and provides a native eval runner with LLM-as-judge (BYOK, provider-agnostic). Use when evaluating skill quality, auditing SKILL.md files, scoring agent skills, generating remediation plans, detecting duplicate skills, validating skill format, enforcing quality gates, optimizing for A-grade publication, comparing audit baselines, batch skill assessments, or checking skill registry compliance. Triggers: 'check my skills', 'skill audit', 'improve my SKILL.md', 'quality check', 'A-grade scoring', 'quality gates', 'eval validation', 'audit all skills', 'remediation plan', 'skill judge', 'dimens

2 Updated 4 days ago
pantheon-org
AI & Automation Solid

skill-optimizer

SkillOpt-flavored offline training loop for any SKILL.md. Treats accumulated learn-rule corrections as training trajectories, proposes bounded patches via an optimizer LLM, gates each candidate against a held-out validation set built from the user's own past corrections, and ships only candidates that demonstrably improve the score. Inspired by Microsoft SkillOpt's ReflACT pipeline (rollout → reflect → aggregate → select → update → evaluate) adapted to pro-workflow's SQLite store. Use when a skill has accumulated 8+ learn-rule rows and the user wants the skill itself to get better, not just longer.

2,651 Updated 6 days ago
rohitg00