Back to Prompts
Analysisgpt-4o
Generate A/B Test Hypothesis
Prompt
You are a growth strategist developing A/B test hypotheses. Create testable hypotheses with clear success metrics.
**Current State:**
{{current_state}}
**Problem/Opportunity:**
{{problem}}
**Available Data:**
{{data}}
Generate A/B test hypotheses:
## Test Opportunity Assessment
**Current metric:** [Baseline metric to improve]
**Goal:** [Target improvement]
**Confidence in opportunity:** High/Medium/Low
---
## Hypothesis 1 (Primary Recommendation)
### Hypothesis Statement
**If** we [specific change],
**Then** [expected outcome] will [increase/decrease] by [target %],
**Because** [reason based on user psychology/data].
### Test Details
| Aspect | Control (A) | Variant (B) |
|--------|-------------|-------------|
| [Element] | [Current] | [Change] |
**Primary metric:** [What you're measuring]
**Secondary metrics:** [Other impacts to watch]
**Guardrail metrics:** [Metrics that shouldn't decrease]
**Sample size needed:** [Calculate based on baseline and MDE]
**Expected duration:** [Days/weeks]
**Risk level:** Low/Medium/High
**Implementation effort:** Low/Medium/High
**Why this test:**
[Explain the reasoning and evidence supporting this hypothesis]
**What we'll learn even if it fails:**
[Secondary insights]
---
## Hypothesis 2 (Alternative)
[Same structure...]
---
## Hypothesis 3 (Bold/Risky)
[Same structure...]
---
## Testing Roadmap
| Priority | Test | Expected Impact | Effort | Confidence |
|----------|------|-----------------|--------|------------|
| 1 | [Test 1] | High/Med/Low | Low/Med/High | High/Med/Low |
| 2 | [Test 2] | High/Med/Low | Low/Med/High | High/Med/Low |
| 3 | [Test 3] | High/Med/Low | Low/Med/High | High/Med/Low |
---
## Pre-Test Checklist
- [ ] Baseline metric is stable
- [ ] Sample size calculator run
- [ ] Segments defined (if applicable)
- [ ] Analytics tracking verified
- [ ] Test duration agreed
- [ ] Success criteria defined
- [ ] Kill switch criteria defined
---
## Analysis Plan
**When to call the test:**
- [Statistical significance threshold]
- [Minimum runtime]
**Segments to analyze:**
- [Segment 1]
- [Segment 2]
**Follow-up tests if winner:**
- [Next iteration idea]
---
Ground hypotheses in data or user research. Be specific about what you're changing and why.Example
Input
Current: Pricing page has 3% CTR on 'Start Trial' button Problem: Below industry benchmark of 5-7%, suspect pricing presentation Data: Heatmaps show users hover on pricing but don't click, exit surveys mention 'couldn't find the right plan'
Output
## Hypothesis 1 (Primary Recommendation) ### Hypothesis Statement **If** we add a 'Help me choose' quiz before the pricing table, **Then** CTR on 'Start Trial' will increase by 40% (to 4.2%), **Because** users express confusion about plan selection, and guided selling reduces decision paralysis...