autoresearch-system

Solid

Karpathy loop for the entire agent architecture. simulate end-to-end workflows, score, find the weakest link, fix, iterate.

AI & Automation 2 stars 0 forks Updated 3 days ago MIT

Install

View on GitHub

Quality Score: 81/100

Stars 20%
16
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Autoresearch System (Architecture-Level Karpathy Loop) ## When to use - A nightly scheduled self-improvement run - Manual trigger: "optimize system", "autoresearch system" - After major architecture changes to validate everything still works ## Test Scenarios Simulate these end-to-end workflows against the current config: ### Scenario 1: Basic inbound message - The user sends a text message via the chat channel - Expected: the default persona responds, tone matches, response via the chat reply tool ### Scenario 2: Intent routing - A message contains signal-related keywords ("just saw this alpha on a protocol") - Expected: routes to `knowledge/research.md`, invokes the signal-scorer skill logic ### Scenario 3: Persona switch + briefing - The user sends "/persona coach" - Expected: switch to coach, load `memory/personas/coach.json`, respond with the coach greeting + context - Note: only the active personas are switchable. Deprecated personas are archived. If the test input is a deleted persona, the expected behavior = inform the user the persona doesn't exist, stay in the default persona. ### Scenario 4: Driving mode activation - The user sends a voice message saying "I'm driving" - Expected: driving mode activates, the response includes a TTS voice note, uses the default voice ### Scenario 5: Knowledge pipeline flow - A substantive output is produced (analysis, draft, plan) from an **interactive session** - Expected: auto-saves to `outputs/raw/{persona}/`, correct fr...

Details

Author
0xUrsanomics
Repository
0xUrsanomics/utopia-os
Created
4 days ago
Last Updated
3 days ago
Language
Python
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

auto-research

Autonomous goal-driven orchestrator. Classifies a natural-language goal, routes it to the right etk/ctk skill, confirms the plan, and executes. Use when: user describes a goal not a method, the right skill is unclear, or you want the agent to pick the approach. Triggers on: auto-research, figure out, fix the, improve the, get coverage, design a, build the, make sure, optimize the, why isn't

6 Updated today
ArieGoldkin
AI & Automation Solid

autoresearch

Autonomous iterative experimentation loop for any programming task. Guides the user through defining goals, measurable metrics, and scope constraints, then runs an autonomous loop of code changes, testing, measuring, and keeping/discarding results. Inspired by Karpathy's autoresearch. USE FOR: autonomous improvement, iterative optimization, experiment loop, auto research, performance tuning, automated experimentation, hill climbing, try things automatically, optimize code, run experiments, autonomous coding loop. DO NOT USE FOR: one-shot tasks, simple bug fixes, code review, or tasks without a measurable metric.

14 Updated yesterday
a-tokyo
AI & Automation Listed

autoresearch

Autonomous goal-directed iteration loop that continuously improves prompts, templates, configs, or code. Two evaluation modes — deterministic (eval.py with proxy heuristics) or AI judge (LLM rubric scoring). Uses four-way separation in both modes. Inspired by Karpathy's autoresearch.

46 Updated 4 days ago
naveedharri