skill-optimize

Solid

Run a structured evaluate-analyze-improve cycle on any GAAI skill to measure quality, detect regressions, and propose targeted improvements. Activate when a skill needs baseline evaluation, after SKILL.md modifications, or when friction-retrospective flags a skill.

AI & Automation 160 stars 27 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 82/100

Stars 20%
73
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Skill Optimize ## Purpose / When to Activate Activate when: - A skill needs a baseline quality measurement (no ledger.yaml exists yet) - A SKILL.md has been modified and a before/after regression check is needed - `friction-retrospective` flags a skill as a recurring friction source - An eval cycle is needed after a manual skill update This skill formalizes the Skill Optimize protocol referenced by `eval-run` (SKILL-CRS-025). It runs the full evaluate-analyze-improve loop with mandatory human gates at every modification step. **Scope:** Any GAAI skill with measurable quality criteria — not limited to content-production skills. The inline Skill Optimize protocol in `discovery.agent.md` remains the agent's orchestration logic; this skill provides the structured execution procedure. --- ## Process ### Step 1 — Eval authoring If no `evals.yaml` exists for the target skill: 1. Read the target `SKILL.md` in full. 2. Identify measurable quality criteria from the `Quality Checks` section. 3. Author `evals.yaml` following the `evals-format.md` spec (see `eval-run/references/evals-format.md`). 4. Include a minimum of 5 assertions with a mix of `code` and `llm-judge` types. 5. Store the file at `{skill-dir}/eval-corpus/evals.yaml`. **HUMAN CHECKPOINT:** Present the drafted `evals.yaml` for validation. Do not proceed until approved. If rejected, revise based on feedback and re-present. ### Step 2 — Corpus generation If no corpus outputs exist in `{skill-dir}/eval-corpus/`: ...

Details

Author
Fr-e-d
Repository
Fr-e-d/GAAI-framework
Created
7 months ago
Last Updated
today
Language
Shell
License
NOASSERTION

Similar Skills

Semantically similar based on skill content — not just same category

Code & Development Listed

skill-optimizer

Evaluate and improve an existing Claude Code skill using explicit success criteria and small controlled changes. Use when the user asks to optimize a skill, reduce over-triggering or under-triggering, improve reliability, tighten instructions, or add evals for a skill. Also trigger on "スキルを改善して", "スキルを最適化して", "スキルの品質を確認して".

3 Updated today
s977043
AI & Automation Listed

skill-improver

Validate every skill in a repository and improve existing ones: structural validation of SKILL.md files on push, description linting against Anthropic's skill-creator guidance, and LLM-driven description optimization from trigger-eval results. Use when adding or editing skills, when skill CI fails, when a skill undertriggers or fires on the wrong queries, or when the user says skill-improver, validate skills, lint my skills, improve this skill, or optimize skill triggering. Not for creating a brand-new skill from scratch with no existing draft.

2 Updated 6 days ago
karozi
AI & Automation Solid

skill-opt-lite

Train and optimize skill documents using the SkillOpt methodology — the agent acts as both target and optimizer, running tasks, reflecting on failures, proposing edits, and validating improvements in a self-contained training loop. TRIGGER: optimize skill, train skill, improve skill, skill training, skill optimization, SkillOpt, skill evolution, skill iteration loop, skill feedback loop, skill tuning.

52 Updated today
rexleimo