Pattern #22: Empowering Headline

Pattern #22  Tested 7 timesFirst tested by Mike Smith Recently tested by Daniel Shapiro on Sep 24, 2020

Based on 7 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Empowering Headline (Variant A) Empowering Headline (Variant B)

Expected Median Effects Of B

X.X%

Progression

(3 tests)

-

Leads

X.X%

Signups

(7 tests)

X.X%

Engagement

(1 tests)

-

Sales

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(7 tests)

All 7 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

35.1% of 90% cumulative power target at 2% MDE from 7 tests Help replicate this with an A/B test

90%
↓
4% 10.3% 5.6% 3.1% 3.8% 7.3% 7.6%
Home & Landing 7 tests: X%

Tested on

Tests

Pattern #22: Empowering Headline
Was Tested On Examine.com by Martin Wong

Replaced

Isolated

Test # 161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Test link

Find Out How It Did With 77,568 Visitors

  • Measured by visits to any listed nutrition articles

  • Measured by email course signups at bottom of article page

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.8%1%
5.6%2%
15.1%5%
44.8%10%
77.4%15%
80%15.5%
94.7%20%

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 316 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Sep 24, 2020 Test link

Find Out How It Did With 25,634 Visitors

  • Measured by signup form completions

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
4.5%1%
7.6%2%
25.6%5%
73.2%10%
80%10.9%
96.9%15%
99.9%20%

In this experiment, the headline was changed to focus more on the end-goal of the UX Academy program - that of landing your first UI/UX role.

Get Access To See The Test Results

Replaced

Isolated

Test # 263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Test link

Find Out How It Did With 53,636 Visitors

  • Measured by successful signups

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
4.4%1%
7.3%2%
24.3%5%
70.4%10%
80%11.3%
95.9%15%
99.8%20%

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Get Access To See The Test Results

Replaced

Isolated

Test # 194 on Bomgar.com by Lee ElkinsLee Elkins Aug 08, 2018 Test link

Find Out How It Did With 12,953 Visitors

  • Measured by form completions

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.1%1%
3.8%2%
6.6%5%
14.5%10%
26.6%15%
42.1%20%
80%32.7%

Get Access To See The Test Results

Replaced

Isolated

Test # 173 on Rollbar.com by Mike SmithMike Smith May 08, 2018 Test link

Find Out How It Did With 8,433 Visitors

  • Measured by succesful signups

  • Measured by successful code integrations

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
2.8%1%
3.1%2%
4.3%5%
6.9%10%
10.6%15%
15.3%20%
80%66.3%

Get Access To See The Test Results

Replaced

Isolated

Test # 74 on Poll-app.com by Pierre Olivier MartelP. Olivier Martel Jan 07, 2017 Test link

Find Out How It Did With 7,217 Visitors

  • Measured by signup starts

  • Measured by signups and poll creation

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
4%0.5%
5.4%1%
10.3%2%
41%5%
80%8.1%
93.2%10%
99.9%15%
99.9%20%

Get Access To See The Test Results

Replaced

Isolated

Test # 92 on Rollbar.com by Mike SmithMike Smith Jan 02, 2017 Test link

Find Out How It Did With 10,179 Visitors

  • Measured by signup page visits

  • Measured by completed signups

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Empowering Headline - Variant A A
Empowering Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.2%1%
4%2%
7.3%5%
17%10%
31.9%15%
50.1%20%
80%29.1%

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.