cli-testing

Solid

Manually test a running Vellum assistant end-to-end purely from the CLI — no desktop app or web UI. Hatch an instance, send messages, watch the reply, and tear it down. Use when verifying assistant behavior, reproducing a bug, or smoke-testing a change without the macOS/web clients.

AI & Automation 648 stars 94 forks Updated today MIT

Install

View on GitHub

Quality Score: 88/100

Stars 20%
94
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# CLI Testing — Exercise the Assistant End-to-End Drive a real assistant from the terminal only. The `vellum` CLI (`cli/`, package `@vellumai/cli`) manages instance lifecycle; `vellum message` / `vellum events` exercise a running instance. See [`cli/AGENTS.md`](../../../cli/AGENTS.md) and the root [`README.md`](../../../README.md) § CLI for command reference. ## 0. Prerequisites ```bash export PATH="$HOME/.bun/bin:$PATH" # bun + the linked `vellum` binary vellum ps # sanity check the CLI resolves ``` If `vellum` is missing, run `./setup.sh` from the repo root once (installs deps, links the `vellum` command). Docker must be running for the default flow below. ## 1. Provide an LLM provider key (from the environment) Local-mode and Docker-mode instances need **one** LLM provider key. The CLI reads it straight from the host environment — just export it before hatching/setup: ```bash export ANTHROPIC_API_KEY=sk-ant-... # or OPENAI_API_KEY / GEMINI_API_KEY / # FIREWORKS_API_KEY / OPENROUTER_API_KEY / # MINIMAX_API_KEY ``` In Devin sessions `ANTHROPIC_API_KEY` is typically already present in the environment — check with `echo "${ANTHROPIC_API_KEY:0:7}"` before asking for one. The CLI maps providers to env vars in [`cli/src/shared/provider-env-vars.ts`](../../../cli/src/shared/provider-env-vars.ts). ## 2. Hatch — default to a Docker hatch built from source **Always def...

Details

Author
vellum-ai
Repository
vellum-ai/vellum-assistant
Created
4 months ago
Last Updated
today
Language
TypeScript
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category