All Latest 490 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto   Dec 21, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #92: Already Viewed Label In Test #215 On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto   Nov 12, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #34: Open In A New Tab In Test #209 On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria   Nov 02, 2018 Desktop Mobile Listing

Julian Gaviria Tested Pattern #88: Action Button In Test #208 On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #196 on Vivareal.com.br by Vinicius Barros Peixoto   Aug 14, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #80: Persistent Filters In Test #196 On Vivareal.com.br

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Test #156 on Mt.com by Vito Mediavilla   Feb 25, 2018 Desktop Listing

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On Mt.com

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #133 on Bing.com by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

 

Test #91 on 3dhubs.com by Rob Draaijer   Jan 01, 2017 Desktop Listing

Rob Draaijer Tested Pattern #9: Multiple Steps In Test #91 On 3dhubs.com

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.