execute-feedback

Solid

Execute tests on generated code and iterate until passing

AI & Automation 142 stars 21 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
72
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Execute Feedback Command Run executable feedback loop on generated code: execute tests, analyze failures, fix, and retry. ## Instructions When invoked, perform the executable feedback loop per REF-013 MetaGPT: 1. **Identify Target** - Load the specified file or recently modified code files - Determine test framework (jest, pytest, cargo test, go test, etc.) - Find existing tests or generate test stubs if none exist 2. **Execute Tests** - Run the specified test command (or auto-detect) - Capture full output (stdout, stderr, exit code) - Parse test results: passed, failed, errors, skipped 3. **Analyze Failures** - For each failing test: - Extract error type and message - Identify root cause (null check, type error, logic error, etc.) - Map to source code location - Check debug memory for similar past failures 4. **Apply Fixes** - Generate targeted fix based on root cause analysis - Apply fix to source code - Increment attempt counter 5. **Re-Execute** - Run tests again after fix - Compare results to previous attempt - If all pass: record success in debug memory, return - If still failing: repeat from step 3 6. **Escalate if Needed** - After max attempts (default: 3), escalate to human - Include: all test results, failure analyses, fix attempts - Save debug memory session 7. **Update Debug Memory** - Record execution session in `.aiwg/ralph/debug-memory/sessions/` - Extract learned patterns to...

Details

Author
jmagly
Repository
jmagly/aiwg
Created
9 months ago
Last Updated
yesterday
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

auto-test-execution

Automatically execute tests when code-generating agents modify source files, enforcing the execute-before-return pattern

142 Updated yesterday
jmagly
AI & Automation Listed

ai-test

Writes tests, enforces TDD (RED-GREEN-REFACTOR), analyzes coverage gaps, defines test strategy across Python, TypeScript, .NET, Rust, Go. Trigger for 'add tests for', 'write a test', 'I need 80 percent coverage', 'plan my test approach', 'TDD this'. Not for failing tests where the fix is unclear; use /ai-debug instead. Not for AI reliability over time; use /ai-reliability-eval instead.

49 Updated today
arcasilesgroup
AI & Automation Listed

auto-feedback-loop

Implement self-correcting agent loops — run tests, capture failures, feed error context back to the writing agent, and repeat until pass or max-attempts reached. Inspired by Microsoft AutoGen's multi-agent reflection pattern. Use when asked about "auto-feedback loop", "self-correcting agent", "AutoGen reflection", "agent retry on failure", "tdd feedback loop", "automatic fix loop", "agent keeps fixing until tests pass", "feedback-loop script", "run-until-green", or "agent self-correction". Do NOT use for: one-shot test runs — see tdd-workflow. Do NOT use for: multi-agent task assignment — see ai-team-workflow.

3 Updated today
phamlongh230-lgtm
AI & Automation Solid

implement

TDD implementation (RED→GREEN→REFACTOR) → verify → review

151 Updated today
mag123c
AI & Automation Solid

generate-tests

Generate comprehensive tests for specified code

4,608 Updated 2 days ago
FlorianBruniaux