Pattern #27: More For Less Headline

Pattern #27  Tested 3 timesFirst tested by Jaymie Friesen Recently tested by Martin Wong on Jan 14, 2018

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
More For Less Headline (Variant A) More For Less Headline (Variant B)

Expected Median Effects Of B

X.X%

Progression

(2 tests)

-

Leads

-

Signups

-

Engagement

X.X%

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(3 tests)

All 3 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

12.5% of 90% cumulative power target at 2% MDE from 3 tests Help replicate this with an A/B test

90%
↓
4.8% 4.1% 4.1%
Home & Landing 1 test: X%
Product 2 tests: X%

Tested on

Tests

Pattern #27: More For Less Headline
Was Tested On Onlinefaxes.com by Jaymie Friesen

Replaced

Isolated

Test # 37 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Apr 09, 2016 Test link

Find Out How It Did With 21,822 Visitors

  • Measured by starting the signup funnel

  • Measured by visits to thank you page (3 more steps)

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
More For Less Headline - Variant A A
More For Less Headline - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.5%1%
4.8%2%
11.1%5%
30.9%10%
58.2%15%
80%19.6%
81.6%20%

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 144 on Examine.com by Martin WongMartin Wong Jan 14, 2018 Test link

Find Out How It Did With 15,542 Visitors

  • Measured by thank you page visits

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
More For Less Headline - Variant A A
More For Less Headline - Variant B B
Product
Statistical Power by Minimum Detectable Effect
3%0.5%
3.2%1%
4.1%2%
7.8%5%
18.8%10%
35.7%15%
55.6%20%
80%27.1%

Get Access To See The Test Results

Replaced

Isolated

Test # 142 on Streamlineicons.... by Vincent Le moignVincent Le moign Jan 13, 2018 Test link

Find Out How It Did With 17,575 Visitors

  • Measured by adds to cart

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
More For Less Headline - Variant A A
More For Less Headline - Variant B B
Product
Statistical Power by Minimum Detectable Effect
3%0.5%
3.2%1%
4.1%2%
8%5%
19.3%10%
36.7%15%
57%20%
80%26.6%

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.