agent-evaluation
FeaturedRun one specified Test Agent on one specified Benchmark Case exactly once, privately score that execution, and return one protocol result.
Install
Quality Score: 93/100
Skill Content
Details
- Author
- Prism-Shadow
- Repository
- Prism-Shadow/penguin-harness
- Created
- 1 months ago
- Last Updated
- today
- Language
- TypeScript
- License
- Apache-2.0
Similar Skills
Semantically similar based on skill content — not just same category
agent-evaluation
Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes, reproducing failures, or running agent regression tests.
agent-evaluation
Designs and runs reproducible evaluations for AI agents, prompts, tools, skills, and model-backed workflows using realistic datasets, isolated baselines, objective assertions, rubric grading, trajectory analysis, cost/latency tracking, and regression comparison. Use when measuring agent quality, optimizing skill triggering, comparing prompts or models, or gating an AI feature release. Not for ordinary deterministic unit tests.
benchmark-design
Design and calibrate a multi-Case capability Benchmark and establish a traceable Formal Baseline.