experiment

Solid

Design, run, and evaluate a controlled A/B test (split test) on your ad accounts with evidence discipline — one variable, a falsifiable hypothesis, a fixed window, and a per-variant outcome verdict. Use when the user asks to run an A/B test, split test, or experiment, to 'test whether X beats Y', to validate a creative-refresh or learning hunch properly, or requests A/Bテスト / スプリットテスト設計 / 実験を回したい / どちらが勝ったか評価して / 仮説を検証したい. Forces a designed experiment instead of an ad-hoc change, records the baseline in action_log, and forbids peeking-based decisions before the window closes.

AI & Automation 16 stars 1 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 78/100

Stars 20%
41
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Experiment > PREREQUISITE: Read `../_mureo-shared/SKILL.md` for auth, security rules, output format, and **Tool Selection** (Read/Write on Code, `mureo_strategy_*` / `mureo_state_*` MCP on Desktop / Cowork). Turn an ad-hoc change into a **designed experiment**. Most "we tried X and CPA moved" claims are noise — one variable was never isolated, the window was never fixed, and the decision was made by peeking. This skill enforces the discipline: a falsifiable hypothesis, exactly **one** variable, a success metric tied to a Goal, a pre-committed duration and sample floor, no peeking, and a per-variant verdict where **inconclusive is a valid outcome**. Read `../_mureo-learning/SKILL.md` first — its **Observation Windows** and **Minimum Sample Sizes** tables set the duration and sample floor this skill commits to, and its evidence lifecycle is the rulebook for the no-peeking rule below. ## Prerequisites - STRATEGY.md and STATE.json must exist (run the `onboard` skill first) ## Steps **Before you start**: Run the **Diagnostic preamble** from ../_mureo-shared/SKILL.md — load learning insights (mureo_learning_insights_get) and consult advisors (mureo_consult_advisor) before drawing conclusions. 1. **Hypothesis intake — force a falsifiable statement**. Take the hypothesis from the operator, from a `/creative-refresh` finding, or from a VALIDATED learning insight, and rewrite it into a single testable sentence with three explicit parts: **variable** (the ONE thing that differs...

Details

Author
logly
Repository
logly/mureo
Created
3 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category