ab-test-plan

Featured

Design A/B and multivariate tests. Use when: sample size calculation, testing hypothesis, CRO experimentation.

AI & Automation 636 stars 110 forks Updated 1 weeks ago MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
93
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# /digital-marketing-pro:ab-test-plan ## Purpose Dedicated A/B test planning with a structured hypothesis framework, statistical sample size calculation, variant design, and monitoring plan. Produces a complete experiment specification with statistical rigor and clear decision criteria. ## Input Required The user must provide (or will be prompted for): - **Element to test**: The specific page, component, or experience being tested (landing page headline, CTA button, pricing page layout, email subject line, checkout flow, form design, etc.) - **Current conversion rate**: Baseline conversion rate for the metric being tested (or best estimate) - **Desired minimum detectable effect (MDE)**: The smallest improvement worth detecting. **MDE is ABSOLUTE by default** — expressed in the same units as the baseline (baseline 5.0% and you want to catch a +1.0 percentage-point lift, i.e. 5.0% → 6.0% ⇒ `--mde 0.01 --mde-type absolute`). To express it as a **relative** lift instead (a 10% relative improvement on a 5% baseline = 5.5% ⇒ `--mde 0.10 --mde-type relative`), pass `--mde-type relative`. This distinction is the single most common sample-size error: the same "10%" read as absolute vs. relative changes the required sample size by roughly 40× at a 5% baseline. Always confirm which the user means. - **Daily traffic or impressions**: Average daily visitors or impressions to the test page or element - **Significance level**: Desired confidence level, default 95% (alpha = 0.05) - **St...

Details

Author
indranilbanerjee
Repository
indranilbanerjee/digital-marketing-pro
Created
5 months ago
Last Updated
1 weeks ago
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

ab-test-planner

Design statistically rigorous A/B tests for product features, UI changes, onboarding flows, and pricing experiments. Use when asked to set up an experiment, design an A/B test, calculate sample size, or interpret test results. Produces a complete test plan with hypothesis, variant definitions, sample size, duration estimate, guardrail metrics, and a results interpretation guide.

1,228 Updated today
mohitagw15856
AI & Automation Featured

ab-test-setup

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "conversion experiment," "statistical significance," or "test this." For tracking implementation, see analytics-tracking.

23,263 Updated 1 weeks ago
alirezarezvani
Web & Frontend Listed

a-b-test-designer

You are a conversion optimization expert. When given a conversion problem, design statistically valid A/B tests with clear hypotheses, variants, and success metrics. ## Process 1. Identify the conversion problem and current metrics 2. Formulate a clear, testable hypothesis 3. Design control and variant(s) 4. Define success metrics and statistical significance 5. Estimate sample size and test duration ## Output Format ## A/B Test Design ### Problem \[Current conversion rate and goal\] ### Hypothesis 'If we \[change\], then \[metric\] will improve because \[reasoning\].' ### Variants - Control (A): Current design - Variant (B): \[Specific change description\] ### Success Metrics - Primary: \[Main metric to track\] - Secondary: \[Supporting metrics\] - Guardrail: \[Metrics that shouldn't decrease\] ### Statistical Plan - Confidence level: 95% - Minimum detectable effect: X% - Estimated...

0 Updated 1 weeks ago
prvthmpcypher