eval-agents

Solid

Audit Claude Code agents defined in .claude/agents/ for description specificity, model tier appropriateness, tools scoping, and system prompt quality. Detects dispatch ambiguity between agents, flags over-permissive tool grants, and checks for human-in-the-loop patterns that break programmatic orchestration. Use when onboarding to a project with existing agents, after adding new agents to a fleet, or when an orchestrator consistently selects the wrong agent.

AI & Automation 4,957 stars 661 forks Updated today CC-BY-SA-4.0

Install

View on GitHub

Quality Score: 96/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Agent Evaluator Discover all agents in scope, score each one across five criteria, then run an interactive session to confirm or improve them one by one. Agents are not just scripts: they are callable units selected by orchestrators based on their description. A vague description silently breaks multi-agent workflows. The goal here is not just scoring; it is leaving every agent correctly scoped, correctly modeled, and safe to call from an orchestrator. ## When to Use - First time auditing an agent fleet before wiring it into an orchestration pipeline - An orchestrator keeps selecting the wrong agent for a task - After copying agents from another project or importing a plugin - A new agent was added; checking whether it conflicts with existing ones - Periodic hygiene: "do all these agents still do something distinct?" ## Key Concepts ### Agent file locations | Location | Scope | Committed? | |---|---|---| | `.claude/agents/<name>.md` | Project (flat file) | Yes | | `.claude/agents/<name>/AGENT.md` | Project (directory-based) | Yes | | `~/.claude/agents/<name>.md` | User-level | No | | Plugin `agents/*.md` | Per plugin | Yes (in plugin) | Both flat files and directory-based agents are valid. The `name:` field is the identifier used by orchestrators and hooks (passed as `agent_type`). The filename does not have to match, though keeping them aligned is recommended. ### Frontmatter fields | Field | Required | Notes | |---|---|---| | `name` | Yes | Unique identifier (ke...

Details

Author
FlorianBruniaux
Repository
FlorianBruniaux/claude-code-ultimate-guide
Created
5 months ago
Last Updated
today
Language
Python
License
CC-BY-SA-4.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category