All Latest 391 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first


Test #156 on by Vito Mediavilla   Feb 25, 2018 Desktop Listing

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #133 on by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue,

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.


Test #91 on by Rob Draaijer   Jan 01, 2017 Desktop Listing

Rob Draaijer Tested Pattern #9: Multiple Steps In Test #91 On

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.