Skills › Marketing Skills › onboarding › experiments.md
experiments.md
258 lines · skills/onboarding/references/experiments.md at 88c79f6
1# Onboarding Experiment Ideas
3Comprehensive list of A/B tests and experiments for user onboarding and activation.
Onboarding Experiment Ideas
Comprehensive list of A/B tests and experiments for user onboarding and activation.
Raw lines 1 to 45## Contents
6- Flow Simplification Experiments (reduce friction, step sequencing, progress & motivation)
7- Guided Experience Experiments (product tours, CTA optimization, UI guidance)
8- Personalization Experiments (user segmentation, dynamic content)
9- Quick Wins & Engagement Experiments (time-to-value, motivation mechanics, support & help)
10- Email & Multi-Channel Experiments (onboarding emails, email content, feedback loops)
11- Re-engagement Experiments (stalled user recovery, return experience)
12- Technical & UX Experiments (performance, mobile onboarding, accessibility)
13- Metrics to Track
Contents
- Flow Simplification Experiments (reduce friction, step sequencing, progress & motivation)
- Guided Experience Experiments (product tours, CTA optimization, UI guidance)
- Personalization Experiments (user segmentation, dynamic content)
- Quick Wins & Engagement Experiments (time-to-value, motivation mechanics, support & help)
- Email & Multi-Channel Experiments (onboarding emails, email content, feedback loops)
- Re-engagement Experiments (stalled user recovery, return experience)
- Technical & UX Experiments (performance, mobile onboarding, accessibility)
- Metrics to Track
Flow Simplification Experiments
Raw lines 15 to 1617### Reduce Friction
19| Test | Hypothesis |
20|------|------------|
21| Email verification timing | During vs. after onboarding |
22| Empty states vs. dummy data | Pre-populated examples |
23| Pre-filled templates | Accelerate setup with templates |
24| OAuth options | Faster account linking |
25| Required step count | Fewer required steps |
26| Optional vs. required fields | Minimize requirements |
27| Skip options | Allow bypassing non-critical steps |
Reduce Friction
| Test | Hypothesis |
|---|---|
| Email verification timing | During vs. after onboarding |
| Empty states vs. dummy data | Pre-populated examples |
| Pre-filled templates | Accelerate setup with templates |
| OAuth options | Faster account linking |
| Required step count | Fewer required steps |
| Optional vs. required fields | Minimize requirements |
| Skip options | Allow bypassing non-critical steps |
29### Step Sequencing
31| Test | Hypothesis |
32|------|------------|
33| Step ordering | Test different sequences |
34| Value-first ordering | Highest-value features first |
35| Friction placement | Move hard steps later |
36| Required vs. optional balance | Ratio of required steps |
37| Single vs. branching paths | One path vs. personalized |
38| Quick start vs. full setup | Minimal path to value |
Step Sequencing
| Test | Hypothesis |
|---|---|
| Step ordering | Test different sequences |
| Value-first ordering | Highest-value features first |
| Friction placement | Move hard steps later |
| Required vs. optional balance | Ratio of required steps |
| Single vs. branching paths | One path vs. personalized |
| Quick start vs. full setup | Minimal path to value |
40### Progress & Motivation
42| Test | Hypothesis |
43|------|------------|
44| Progress bars | Show completion percentage |
45| Checklist length | 3-5 items vs. 5-7 items |
46| Gamification | Badges, rewards, achievements |
47| Completion messaging | "X% complete" visibility |
48| Starting point | Begin at 20% vs. 0% |
49| Celebration moments | Acknowledge completions |
51---
Progress & Motivation
| Test | Hypothesis |
|---|---|
| Progress bars | Show completion percentage |
| Checklist length | 3-5 items vs. 5-7 items |
| Gamification | Badges, rewards, achievements |
| Completion messaging | "X% complete" visibility |
| Starting point | Begin at 20% vs. 0% |
| Celebration moments | Acknowledge completions |
Raw lines 40 to 52
Guided Experience Experiments
Raw lines 53 to 5455### Product Tours
57| Test | Hypothesis |
58|------|------------|
59| Interactive tours | Tools like Navattic, Storylane |
60| Tooltip vs. modal guidance | Subtle vs. attention-grabbing |
61| Video tutorials | For complex workflows |
62| Self-paced vs. guided | User control vs. structured |
63| Tour length | Shorter vs. comprehensive |
64| Tour triggering | Automatic vs. user-initiated |
Product Tours
| Test | Hypothesis |
|---|---|
| Interactive tours | Tools like Navattic, Storylane |
| Tooltip vs. modal guidance | Subtle vs. attention-grabbing |
| Video tutorials | For complex workflows |
| Self-paced vs. guided | User control vs. structured |
| Tour length | Shorter vs. comprehensive |
| Tour triggering | Automatic vs. user-initiated |
66### CTA Optimization
68| Test | Hypothesis |
69|------|------------|
70| CTA text variations | Action-oriented copy testing |
71| CTA placement | Position within screens |
72| In-app tooltips | Feature discovery prompts |
73| Sticky CTAs | Persist during onboarding |
74| CTA contrast | Visual prominence |
75| Secondary CTAs | "Learn more" vs. primary only |
CTA Optimization
| Test | Hypothesis |
|---|---|
| CTA text variations | Action-oriented copy testing |
| CTA placement | Position within screens |
| In-app tooltips | Feature discovery prompts |
| Sticky CTAs | Persist during onboarding |
| CTA contrast | Visual prominence |
| Secondary CTAs | "Learn more" vs. primary only |
77### UI Guidance
79| Test | Hypothesis |
80|------|------------|
81| Hotspot highlights | Draw attention to key features |
82| Coachmarks | Contextual tips |
83| Feature announcements | New feature discovery |
84| Contextual help | Help where users need it |
85| Search vs. guided | Self-service vs. directed |
87---
UI Guidance
| Test | Hypothesis |
|---|---|
| Hotspot highlights | Draw attention to key features |
| Coachmarks | Contextual tips |
| Feature announcements | New feature discovery |
| Contextual help | Help where users need it |
| Search vs. guided | Self-service vs. directed |
Raw lines 77 to 88
Personalization Experiments
Raw lines 89 to 9091### User Segmentation
93| Test | Hypothesis |
94|------|------------|
95| Role-based onboarding | Different paths by role |
96| Goal-based paths | Customize by stated goal |
97| Role-specific dashboards | Relevant default views |
98| Use-case question | Personalize based on answer |
99| Industry-specific paths | Vertical customization |
100| Experience-based | Beginner vs. expert paths |
User Segmentation
| Test | Hypothesis |
|---|---|
| Role-based onboarding | Different paths by role |
| Goal-based paths | Customize by stated goal |
| Role-specific dashboards | Relevant default views |
| Use-case question | Personalize based on answer |
| Industry-specific paths | Vertical customization |
| Experience-based | Beginner vs. expert paths |
102### Dynamic Content
104| Test | Hypothesis |
105|------|------------|
106| Personalized welcome | Name, company, role |
107| Industry examples | Relevant use cases |
108| Dynamic recommendations | Based on user answers |
109| Template suggestions | Pre-filled for segment |
110| Feature highlighting | Relevant to stated goals |
111| Benchmark data | Industry-specific metrics |
113---
Dynamic Content
| Test | Hypothesis |
|---|---|
| Personalized welcome | Name, company, role |
| Industry examples | Relevant use cases |
| Dynamic recommendations | Based on user answers |
| Template suggestions | Pre-filled for segment |
| Feature highlighting | Relevant to stated goals |
| Benchmark data | Industry-specific metrics |
Raw lines 102 to 114
Quick Wins & Engagement Experiments
Raw lines 115 to 116117### Time-to-Value
119| Test | Hypothesis |
120|------|------------|
121| First quick win | "Complete your first X" |
122| Success messages | After key actions |
123| Progress celebrations | Milestone moments |
124| Next step suggestions | After each completion |
125| Value demonstration | Show what they achieved |
126| Outcome preview | What success looks like |
Time-to-Value
| Test | Hypothesis |
|---|---|
| First quick win | "Complete your first X" |
| Success messages | After key actions |
| Progress celebrations | Milestone moments |
| Next step suggestions | After each completion |
| Value demonstration | Show what they achieved |
| Outcome preview | What success looks like |
128### Motivation Mechanics
130| Test | Hypothesis |
131|------|------------|
132| Achievement badges | Gamification elements |
133| Streaks | Consecutive day engagement |
134| Leaderboards | Social comparison (if appropriate) |
135| Rewards | Incentives for completion |
136| Unlock mechanics | Features revealed progressively |
Motivation Mechanics
| Test | Hypothesis |
|---|---|
| Achievement badges | Gamification elements |
| Streaks | Consecutive day engagement |
| Leaderboards | Social comparison (if appropriate) |
| Rewards | Incentives for completion |
| Unlock mechanics | Features revealed progressively |
138### Support & Help
140| Test | Hypothesis |
141|------|------------|
142| Free onboarding calls | For complex products |
143| Contextual help | Throughout onboarding |
144| Chat support | Availability during onboarding |
145| Proactive outreach | For stuck users |
146| Self-service resources | Help docs, videos |
147| Community access | Peer support early |
149---
Support & Help
| Test | Hypothesis |
|---|---|
| Free onboarding calls | For complex products |
| Contextual help | Throughout onboarding |
| Chat support | Availability during onboarding |
| Proactive outreach | For stuck users |
| Self-service resources | Help docs, videos |
| Community access | Peer support early |
Raw lines 138 to 150
Email & Multi-Channel Experiments
Raw lines 151 to 152153### Onboarding Emails
155| Test | Hypothesis |
156|------|------------|
157| Founder welcome email | Personal vs. generic |
158| Behavior-based triggers | Action/inaction based |
159| Email timing | Immediate vs. delayed |
160| Email frequency | More vs. fewer touches |
161| Quick tips format | Short actionable content |
162| Video in email | More engaging format |
Onboarding Emails
| Test | Hypothesis |
|---|---|
| Founder welcome email | Personal vs. generic |
| Behavior-based triggers | Action/inaction based |
| Email timing | Immediate vs. delayed |
| Email frequency | More vs. fewer touches |
| Quick tips format | Short actionable content |
| Video in email | More engaging format |
164### Email Content
166| Test | Hypothesis |
167|------|------------|
168| Subject lines | Open rate optimization |
169| Personalization depth | Name vs. behavior-based |
170| CTA prominence | Single clear action |
171| Social proof inclusion | Testimonials in email |
172| Urgency messaging | Trial reminders |
173| Plain text vs. designed | Format testing |
Email Content
| Test | Hypothesis |
|---|---|
| Subject lines | Open rate optimization |
| Personalization depth | Name vs. behavior-based |
| CTA prominence | Single clear action |
| Social proof inclusion | Testimonials in email |
| Urgency messaging | Trial reminders |
| Plain text vs. designed | Format testing |
175### Feedback Loops
177| Test | Hypothesis |
178|------|------------|
179| NPS during onboarding | When to ask |
180| Blocking question | "What's stopping you?" |
181| NPS follow-up | Actions based on score |
182| In-app feedback | Thumbs up/down on features |
183| Survey timing | When to request feedback |
184| Feedback incentives | Reward for completing |
186---
Feedback Loops
| Test | Hypothesis |
|---|---|
| NPS during onboarding | When to ask |
| Blocking question | "What's stopping you?" |
| NPS follow-up | Actions based on score |
| In-app feedback | Thumbs up/down on features |
| Survey timing | When to request feedback |
| Feedback incentives | Reward for completing |
Raw lines 175 to 187
Re-engagement Experiments
Raw lines 188 to 189190### Stalled User Recovery
192| Test | Hypothesis |
193|------|------------|
194| Re-engagement email timing | When to send |
195| Personal outreach | Human vs. automated |
196| Simplified path | Reduced steps for returners |
197| Incentive offers | Discount or extended trial |
198| Problem identification | Ask what's blocking |
199| Demo offer | Live walkthrough |
Stalled User Recovery
| Test | Hypothesis |
|---|---|
| Re-engagement email timing | When to send |
| Personal outreach | Human vs. automated |
| Simplified path | Reduced steps for returners |
| Incentive offers | Discount or extended trial |
| Problem identification | Ask what's blocking |
| Demo offer | Live walkthrough |
201### Return Experience
203| Test | Hypothesis |
204|------|------------|
205| Welcome back message | Acknowledge return |
206| Progress resume | Pick up where left off |
207| Changed state | What happened while away |
208| Re-onboarding | Fresh start option |
209| Urgency messaging | Trial time remaining |
211---
Return Experience
| Test | Hypothesis |
|---|---|
| Welcome back message | Acknowledge return |
| Progress resume | Pick up where left off |
| Changed state | What happened while away |
| Re-onboarding | Fresh start option |
| Urgency messaging | Trial time remaining |
Raw lines 201 to 212
Technical & UX Experiments
Raw lines 213 to 214215### Performance
217| Test | Hypothesis |
218|------|------------|
219| Load time optimization | Faster = higher completion |
220| Progressive loading | Perceived performance |
221| Offline capability | Mobile experience |
222| Error handling | Graceful failure recovery |
Performance
| Test | Hypothesis |
|---|---|
| Load time optimization | Faster = higher completion |
| Progressive loading | Perceived performance |
| Offline capability | Mobile experience |
| Error handling | Graceful failure recovery |
224### Mobile Onboarding
226| Test | Hypothesis |
227|------|------------|
228| Touch targets | Size and spacing |
229| Swipe navigation | Mobile-native patterns |
230| Screen count | Fewer screens needed |
231| Input optimization | Mobile-friendly forms |
232| Permission timing | When to ask |
Mobile Onboarding
| Test | Hypothesis |
|---|---|
| Touch targets | Size and spacing |
| Swipe navigation | Mobile-native patterns |
| Screen count | Fewer screens needed |
| Input optimization | Mobile-friendly forms |
| Permission timing | When to ask |
234### Accessibility
236| Test | Hypothesis |
237|------|------------|
238| Screen reader support | Accessibility impact |
239| Keyboard navigation | Non-mouse users |
240| Color contrast | Visibility |
241| Font sizing | Readability |
243---
Accessibility
| Test | Hypothesis |
|---|---|
| Screen reader support | Accessibility impact |
| Keyboard navigation | Non-mouse users |
| Color contrast | Visibility |
| Font sizing | Readability |
Raw lines 234 to 244
245## Metrics to Track
247For all experiments, measure:
249| Metric | Description |
250|--------|-------------|
251| Activation rate | % reaching activation event |
252| Time to activation | Hours/days to first value |
253| Step completion rate | % completing each step |
254| Drop-off points | Where users abandon |
255| Return rate | Users who come back |
256| Day 1/7/30 retention | Engagement over time |
257| Feature adoption | Which features get used |
258| Support requests | Volume during onboarding |
Metrics to Track
For all experiments, measure:
| Metric | Description |
|---|---|
| Activation rate | % reaching activation event |
| Time to activation | Hours/days to first value |
| Step completion rate | % completing each step |
| Drop-off points | Where users abandon |
| Return rate | Users who come back |
| Day 1/7/30 retention | Engagement over time |
| Feature adoption | Which features get used |
| Support requests | Volume during onboarding |