autoresearch

Solid

Autonomous skill-prompt optimization — Karpathy-style mutate/score/keep loop on SKILL.md. Triggers "autoresearch", "optimize skill", "tune", "evolve" a skill, "prompt optimization".

AI & Automation 44 stars 3 forks Updated today MIT

Install

View on GitHub

Quality Score: 87/100

Stars 20%
55
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# AutoResearch ## Standalone Codex: unsupported Stop here in standalone Codex. This workflow depends on a measured Claude subprocess isolation and model-pinning loop. Do not substitute native agents or claim comparable scores until a Codex equivalent has its own controlled, repeatable measurements. The remaining workflow is Claude-only. Autonomous skill optimization. You modify a skill's prompt, test it, keep improvements, revert failures. Repeat forever. Adapted from [Karpathy's autoresearch](https://github.com/karpathy/autoresearch). Same method: single editable file, single metric, git-based keep/revert, autonomous loop. The only difference: `SKILL.md` replaces `train.py`, checklist pass rate replaces `val_bpb`. **NEVER STOP.** Once the loop begins, do NOT pause to ask the human if you should continue. The human might be away and expects you to work indefinitely until manually interrupted. If you run out of ideas, think harder — re-read failing outputs, try combining near-misses, try more radical prompt rewrites. The loop runs until the human interrupts you, period. --- ## Setup Work with the user to configure, then go autonomous. 1. **Parse target skill**: Get `<skill-name>` from `$ARGUMENTS`. Validate `skills/<skill-name>/SKILL.md` exists. 2. **Load or create RESEARCH.md**: Check for `skills/<skill-name>/RESEARCH.md`. If it exists, read it — a skill born from `/harvest` arrives with a seeded RESEARCH.md whose `## Test Inputs` are the harvest trap prompts and wh...

Details

Author
darkroomengineering
Repository
darkroomengineering/cc-settings
Created
8 months ago
Last Updated
today
Language
TypeScript
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

autoresearch

Autonomously optimize any Claude Code skill by running it repeatedly, scoring outputs against binary evals, mutating the prompt, and keeping improvements. Based on Karpathy's autoresearch methodology. Use when: optimize this skill, improve this skill, run autoresearch on, make this skill better, self-improve skill, benchmark skill, eval my skill, run evals on. Outputs: an improved SKILL.md, a results log, and a changelog of every mutation tried.

2 Updated today
marcioaltoe
AI & Automation Solid

auto-optimize

Autonomously optimize any Claude Code skill by running it repeatedly, scoring against binary evals, mutating the prompt, and keeping improvements. Use when: optimize/improve/benchmark/eval a skill, autoresearch, auto-optimize. Not for creating skills from scratch (use skill-creator-pro).

51 Updated today
LeeJuOh
AI & Automation Listed

auto-research

Improve any existing Claude Code skill, CLAUDE.md, subagent definition, slash-command, or prompt markdown file by combining web-researched best-practice rewrites with autonomous Karpathy-style binary eval loops. Use when the user wants to "auto-research", "self-improve", "auto-improve", "optimize", "modernize", or "research-improve" any existing SKILL.md, CLAUDE.md, agent file under .claude/agents/, slash-command file under .claude/commands/, or any prompt markdown file. Triggers on phrases like "use auto-research to improve skill X", "auto-improve this CLAUDE.md", "research best practices and rewrite Y", or "self-research and optimize this agent". Researches authoritative sources (Anthropic docs, anthropic.com engineering blog, anthropics/skills GitHub) in parallel sub-agents, proposes a cited rewrite, runs an autonomous binary-assertion eval loop with git commit and reset bookkeeping for testable artifacts, and asks the user to confirm only at the end with a before-and-after score and full source list.

22 Updated 3 weeks ago
maystudios