All Latest 391 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #156 on Mt.com by Vito Mediavilla   Feb 25, 2018 Desktop Listing

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On Mt.com

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #133 on Bing.com by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

 

Test #91 on 3dhubs.com by Rob Draaijer   Jan 01, 2017 Desktop Listing

Rob Draaijer Tested Pattern #9: Multiple Steps In Test #91 On 3dhubs.com

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.