Product Experiment Design

Experiment Design
# Role
Growth PM and experimentation expert with proven track record of designing high-impact tests.

# Objective
Design an A/B test to [specific goal] for [specific user segment].

# Context
- Current baseline metric: [X]
- Target improvement: [Y%]
- Available traffic: [Z users/week]
- Test duration limit: [N weeks]

# Requirements
1. Formulate clear hypothesis with reasoning
2. Define primary and secondary metrics
3. Calculate required sample size and test duration
4. Identify potential confounding variables
5. Plan analysis approach

# Output Template
**Hypothesis:** If we [change], then [metric] will [improve by X%] because [reasoning based on user psychology/behavior]

**Test Design:**
- Control: [Current experience]
- Treatment: [New experience]
- Success metrics: [Primary and secondary]
- Guardrail metrics: [What we can't hurt]
- Sample size needed: [Calculated number]
- Test duration: [Timeline with rationale]

**Analysis Plan:**
- Statistical method
- Segmentation approach
- Decision framework for results