digitalocean-benchmark-runner

Solid

DigitalOcean benchmarks: Use when an agent must provision, operate, or clean up ephemeral DigitalOcean Droplets for Go, PostgreSQL, or external HTTP benchmark execution, including private dirty source or a separate k6 generator. Own secure paid-resource lifecycle, same-testbed comparison, artifact return, and cleanup; Skip when measurement stays local, the workload or budget is undecided, or only code-level performance analysis is requested.

API & Backend 6 stars 1 forks Updated today MIT

Install

View on GitHub

Quality Score: 78/100

Stars 20%
28
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# DigitalOcean Benchmark Runner Read [Benchmarking](../../../docs/benchmarking.md) and the [DigitalOcean runbook](references/digitalocean.md). Keep measurement in the repository's existing `make bench*` targets; this skill owns only remote execution. ## Execute 1. Confirm the workload, maximum spend, benchmark level, and whether external paid writes are authorized. `check`, `list`, and `image-list` are read-only; `create`, `run`, and `image-build` incur cost, while a created snapshot keeps incurring storage cost until deletion. One authorization covers agent-selected placements and bounded retries that stay inside its cost, security, and proof envelope; do not seek approval per host or attempt. 2. For an ordinary benchmark request, use DigitalOcean only when `doctl` is already installed and the selected context is authorized. Otherwise stop the remote path and use the matching local command. When the user explicitly asks to configure DigitalOcean, follow the runbook's account/workstation onboarding: the user owns browser, payment, token, and passphrase entry; the agent may perform the requested local setup and read-only verification but must never request or echo those secrets. A real setup smoke still needs explicit paid-write authorization. 3. Run `scripts/dev/benchmark-remote.sh list` and resolve placement from current provider data before provisioning. `DO_BENCH_REGION` and `DO_BENCH_SIZE` are agent-owned inputs unless geography or hardware is part of the accepted clai...

Details

Author
Dankosik
Repository
Dankosik/go-service-template-rest
Created
4 months ago
Last Updated
today
Language
Go
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

nasde-benchmark-runner

Run coding agent benchmarks and verify results with nasde. Use this skill when the user wants to: - Run a benchmark (all tasks, single task, specific variant) - Re-run assessment evaluation on existing trial results - Check or verify results in Opik (traces, feedback scores, experiments) - Troubleshoot a failed benchmark run - View or compare trial results Even if the user doesn't say "benchmark" — if they're talking about running evaluations, checking scores, or analyzing agent performance, this skill applies. After every run that uses --with-opik, ALWAYS verify results via Opik REST API — don't wait for the user to ask.

11 Updated today
NoesisVision
AI & Automation Solid

benchmark-models

Cross-model benchmark. Runs one prompt or skill through Claude, GPT (Codex CLI), and Gemini side by side and compares latency, tokens, cost, tool calls, and optionally output quality via an Anthropic-API judge. Answers "which model is actually best for this skill?" with data. Use when you say "benchmark models", "compare models", "which model is best for X", "cross-model comparison", or "model shootout". Do NOT use to measure web page performance.

38 Updated today
rjmurillo
API & Backend Solid

benchmark

Benchmark one session (or a small recent set) against the rolling average using Agent Monitor data — cost, total tokens, tool count, and workflow complexity score — and report where each metric lands as a percentile of the population. Tells you whether a session was normal, cheap, or an outlier. Use when judging whether a session was typical or out of band.

850 Updated today
hoangsonww