create-skill-test

# Create Skill Test This skill helps you scaffold evaluation tests (`eval.yaml`) for agent skills, ensuring they conform to the dotnet/skills repository conventions, pass the skill-validator checks, and avoid common overfitting pitfalls. ## When to Use - Creating a new `eval.yaml` test file for a skill - Adding scenarios to an existing eval file - Setting up test fixture files alongside eval definitions - Reviewing whether rubric items and assertions risk overfitting ## When Not to Use - Running or debugging existing tests (use the skill-validator directly) - Modifying the skill-validator tool itself - Creating or editing SKILL.md files (use the `create-skill` skill) ## Inputs | Input | Required | Description | |-------|----------|-------------| | Skill name | Yes | The skill being tested (must match a skill under `plugins/<plugin>/skills/`) | | Plugin name | Yes | The plugin the skill belongs to (e.g., `dotnet-msbuild`) | | Skill content | Recommended | The SKILL.md content to understand what the skill teaches | | Scenario descriptions | Recommended | What situations the agent should be tested on | ## Workflow ### Step 1: Locate the target and determine the test directory Tests live at: ``` # For skills: tests/<plugin>/<skill-name>/eval.yaml # For agents (agent. prefix convention): tests/<plugin>/agent.<agent-name>/eval.yaml ``` For skills, verify the skill exists at `plugins/<plugin>/skills/<skill-name>/SKILL.md`. For agents, verify the agent exists at `plugins...