smithers-optimize

Solid

Run GEPA prompt optimization over a workflow eval suite and write an optimized prompt artifact. Run `smithers optimize --help` for usage details.

AI & Automation 338 stars 43 forks Updated today MIT

Install

View on GitHub

Quality Score: 85/100

Stars 20%
84
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
79
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# smithers optimize Run GEPA prompt optimization over a workflow eval suite and write an optimized prompt artifact. ## Arguments | Name | Type | Required | Description | |------|------|----------|-------------| | `workflow` | `string` | yes | Workflow ID (from `smithers workflow list`) or path to a .tsx workflow file | ## Options | Flag | Type | Default | Description | |------|------|---------|-------------| | `--cases` | `string` | | JSON or JSONL eval case file | | `--suite` | `string` | | Stable suite ID used in run IDs and report paths | | `--provider` | `string` | `openai-api` | GEPA patch generator provider | | `--model` | `string` | | Optimizer model for provider-backed GEPA | | `--artifact` | `string` | | Write the optimized prompt artifact to this path | | `--reportDir` | `string` | | Directory for baseline and optimized eval reports | | `--minImprovement` | `number` | `0.000001` | Minimum required absolute score improvement | | `--maxCases` | `number` | | Run only the first N cases | | `--concurrency` | `number` | `1` | Number of eval cases to run at once | | `--maxConcurrency` | `number` | | Per-workflow max task concurrency | | `--root` | `string` | | Tool sandbox root directory | | `--log` | `boolean` | `true` | Enable NDJSON event log file output | | `--logDir` | `string` | | NDJSON event logs directory | | `--allowNetwork` | `boolean` | `false` | Allow bash tool network requests | | `--maxOutputBytes` | `number` | | Max bytes a single tool call c...

Details

Author
smithersai
Repository
smithersai/smithers
Created
6 months ago
Last Updated
today
Language
JavaScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category