ab-test-setup

version: 4.1.0-fractal name: ab-test-setup description: Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.

A/B Test Setup

1️⃣ Purpose & Scope

Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.

• Prevents "peeking"
• Enforces statistical power
• Blocks invalid hypotheses

2️⃣ Pre-Requisites

You must have:

• A clear user problem
• Access to an analytics source
• Roughly estimated traffic volume

🧠 Knowledge Modules (Fractal Skills)

1. Hypothesis Quality Checklist

2. 3️⃣ Hypothesis Lock (Hard Gate)

3. 4️⃣ Assumptions & Validity Check (Mandatory)

4. 5️⃣ Test Type Selection

5. 6️⃣ Metrics Definition

6. 7️⃣ Sample Size & Duration

7. 8️⃣ Execution Readiness Gate (Hard Stop)

8. During the Test

9. Analysis Discipline

10. Interpretation Outcomes

11. Test Record (Mandatory)