All Latest 582 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #138 on Trydesignlab.com by Daniel Shapiro   Dec 22, 2017 Desktop Mobile Checkout

Daniel Shapiro Tested Pattern #42: Countdown Timer In Test #138 On Trydesignlab.com

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #136 on Missetam.nl by Marlies Wilms Floet   Dec 18, 2017 Desktop Product

Marlies Wilms Floet Tested Pattern #42: Countdown Timer In Test #136 On Missetam.nl

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Test #133 on Bing.com by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

 

Test #106 on Examine.com by Martin Wong   May 23, 2017 Desktop Product

Martin Wong Tested Pattern #15: Bulleted Reassurances In Test #106 On Examine.com

Three reassurances were added underneath each purchase button: Lifetime Updates, Works On All Devices and Money-Back Guarantee.