All Latest 490 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first


Test #215 on by Vinicius Barros Peixoto   Dec 21, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #92: Already Viewed Label In Test #215 On

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #209 on by Vinicius Barros Peixoto   Nov 12, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #34: Open In A New Tab In Test #209 On

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on by Julian Gaviria   Nov 02, 2018 Desktop Mobile Listing

Julian Gaviria Tested Pattern #88: Action Button In Test #208 On

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #196 on by Vinicius Barros Peixoto   Aug 14, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #80: Persistent Filters In Test #196 On

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Test #156 on by Vito Mediavilla   Feb 25, 2018 Desktop Listing

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #133 on by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue,

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.


Test #91 on by Rob Draaijer   Jan 01, 2017 Desktop Listing

Rob Draaijer Tested Pattern #9: Multiple Steps In Test #91 On

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.