inngest-agent-evalslisted

Use when building, migrating, or debugging Agent Evals on Inngest: scoring AI agent or workflow outcomes, deferred scorers, sessions, traces, step experiments, experiment variant attribution, Insights queries, or production eval loops for prompts, models, tools, providers, and agent behavior. Covers TypeScript SDK v4 scoring beta APIs, `scoreMiddleware`, `step.score`, `inngest.score`, `createScorer`, `defer`, `group.experiment`, `experimentRef`, `meta.sessions`, and when to use durable workflow primitives for outcome-based evaluation.
DrOlu/agent-skills · ★ 0 · AI & Automation · score 60

Install: claude install-skill DrOlu/agent-skills

# Inngest Agent Evals Use this skill when the user wants to evaluate AI agents or AI workflows in production, add scoring, compare prompts/models/tools, group related runs, or debug why an agent outcome was good or bad. Agent Evals is not a separate package. It is the production evaluation workflow built from Inngest functions, durable steps, scores, deferred scorers, sessions, traces, experiments, and Insights. ## Canonical References Check the public docs first when exact API details matter: - Agent Evals overview: https://www.inngest.com/docs/learn/agent-evals - Scoring guide: https://www.inngest.com/docs/features/inngest-functions/steps-workflows/scoring - Deferred scoring guide: https://www.inngest.com/docs/features/inngest-functions/steps-workflows/deferred-scoring - Step experiments guide: https://www.inngest.com/docs/features/inngest-functions/steps-workflows/step-experiments - Sessions: https://www.inngest.com/docs/features/events-triggers/sessions - Traces: https://www.inngest.com/docs/platform/monitor/traces - Insights: https://www.inngest.com/docs/platform/monitor/insights - Scoring reference: https://www.inngest.com/docs/reference/typescript/v4/functions/scoring - `group.experiment()` reference: https://www.inngest.com/docs/reference/typescript/v4/functions/group-experiment - Launch context: https://www.inngest.com/blog/introducing-agent-evals ## Decision Flow Start from the outcome, not the mechanism: 1. Identify the product or quality signal: helpful cl