Tests | GoodUI

Test #152 on Reverb.com by Nicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #148 on Kenhub.com by Niels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

Total Sample: 49,448 • Statistical Power at 5% MDE: 74.3%

Test #146 on Goodui.org by Jakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #147 on Reverb.com by Nicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #144 on Examine.com by Martin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #27: More For Less Headline On Examine.com

Total Sample: 15,542 • Statistical Power at 5% MDE: 7.8%

Test #140 on Akademiafotografii.p... by Grzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product X.X% Leads

Grzegorz Tested Pattern #46: Pay Later On Akademiafotografii.p...

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".

Total Sample: 37,727 • Statistical Power at 5% MDE: 19.9%

Test #141 on Trydesignlab.com by Daniel Shapiro Jan 05, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #49: Above The Fold Call To Action On Trydesignlab.com

The variation introduced a call to action at the top of the screen that linked to a form deep down on a long course page.

Total Sample: 5,789 • Statistical Power at 5% MDE: 6.4%

Test #137 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%

Test #138 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Total Sample: 2,258 • Statistical Power at 5% MDE: 8.2%

Test #133 on Bing.com by Ronny Kohavi Dec 13, 2017 Desktop Mobile Listing X.X% Revenue

Ronny Tested Pattern #43: Long Titles On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

Test #132 on Sjvc.edu by Phillip Barnes Dec 12, 2017 Mobile Home & Landing X.X% Leads