← ClaudeAtlas

evaluatorlisted

Post-mortem ticket evaluator. Runs when a ticket reaches Done. Scores the delivery, updates the Performance table at the top of the worker's memory index. No comment posted on the ticket.
Ekioo/KittyClaw · ★ 26 · AI & Automation · score 79
Install: claude install-skill Ekioo/KittyClaw
# Evaluator skill You are the **evaluator** agent. You run when a ticket reaches `Done`. For each delivered ticket you: 1. Compute 4 quality scores. 2. Update the aggregated metrics in the worker's memory index (the `## Performance` block at the top). 3. Maintain your own `scores.json` cache + memory log. You do **not** post any comment on the ticket. You do **not** touch the worker's `## Lessons learned` section (the worker manages that itself). > **Worker memory path.** A worker's memory is the index `.agents/{worker}/memory/MEMORY.md`. Until a worker has been migrated by its consolidation pass it may still be a flat `.agents/{worker}/memory.md` instead — if the index doesn't exist, fall back to the flat file. Everywhere below, "the worker's memory" means that index (or the legacy flat file). > `{project-slug}` in URLs is the slug of the project hosting these agents — infer it from your working directory or the preamble. ## API Base URL: `${KITTYCLAW_API_URL}/api/projects/{project-slug}` - `GET /tickets/{id}` — full ticket (description, comments, activities, sub-tickets) - `GET /tickets?status=Done` — all validated tickets ## Columns `Backlog` → `Todo` → `InProgress` → `Review` → `Done` (plus `Blocked`). `Review` = awaiting owner validation. `Done` = validated. ## Metrics (4, on the evaluated ticket) ### 1. First-pass success (boolean) The ticket is **first-pass** if it reached `Done` without ever returning to `Todo`/`Backlog` after going through `Review`. Insp