suede-ab-testing

Featured

Suede-owned experimentation discipline for hypotheses, sample sizing, test duration, significance, and repeatable experiment programs. Use when comparing variants, deciding whether a result is reliable, or building an experiment backlog and cadence. NOT FOR: analytics instrumentation (use suede-analytics), post-click conversion diagnosis (use suede-site-alchemy), or writing the variant copy itself (use suede-copy).

AI & Automation 135 stars 10 forks Updated today MIT

Install

View on GitHub

Quality Score: 89/100

Stars 20%
71
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Suede A/B Test Setup Use this Suede experimentation playbook to design tests that produce statistically valid, actionable results. ## The Iron Law ``` Predeclare three things before a test launches — sample per variant, minimum duration, and the decision rule — and read the result only once all three are satisfied. A result read before then is preliminary. Never a winner. ``` - **Sample per variant**: the Sample Size table below, or a calculator run on your actual baseline. - **Minimum duration**: 1 full week (day-of-week variation), 2 business cycles (B2B), through paydays (e-commerce) — see the "Minimum Duration Rules" section of [references/sample-size-guide.md](references/sample-size-guide.md). - **Decision rule**: which metric, at which threshold, decides the call — written down before launch, not after. Two carve-outs, and only these two: - A **predeclared sequential or always-valid design** may look early under its own stopping rule (see "Sequential Testing" in the sample-size guide). Declaring it sequential after the peek does not count. - A **guardrail-triggered stop for harm** is a stop, not a winner call. Kill the variant, report no result. ## Initial Assessment Check for `.agents/product-marketing.md` (or `.claude/product-marketing.md`, or the legacy `product-marketing-context.md`) and read it if present — baseline conversion rate, traffic volume, and available tooling decide whether a test is even powerable, and they are usually already written down the...

Details

Author
JasonColapietro
Repository
JasonColapietro/suede-creator-skills
Created
3 months ago
Last Updated
today
Language
JavaScript
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

suede-analytics

Suede-owned measurement discipline for tracking plans, event and conversion instrumentation, UTM and campaign-parameter hygiene, and verification of what actually fires. Use when setting up, auditing, or repairing analytics across web, product, paid, and lifecycle surfaces. NOT FOR: experiment design or significance decisions (use suede-ab-testing), campaign optimization (use suede-ads), attribution models, model comparison, or cross-tool reconciliation (use suede-attribution), or revenue-process architecture (use suede-revops).

135 Updated today
JasonColapietro
Testing & QA Listed

ab-test-setup

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," or "how long should I run this test." Use this whenever someone is comparing two approaches and wants to measure which performs better. For tracking implementation, see tracking-setup. For page-level conversion optimization, see page-cro.

1 Updated 1 weeks ago
t0ddharris
AI & Automation Featured

suede-ad-creative

Suede-owned paid-media creative system for hooks, headlines, primary text, static and motion concepts, platform specs, review pages, and test-ready variant batches. Use when producing or iterating ad creative from grounded product and audience inputs. NOT FOR: campaign budgets, bidding, or targeting (use suede-ads), statistical test design (use suede-ab-testing), or landing-page copy (use suede-copy).

135 Updated today
JasonColapietro