All Latest 510 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #240 on Thomasnet.com by Julian Gaviria   May 16, 2019 Desktop Listing

Julian Gaviria Tested Pattern #13: Centered Forms & Buttons In Test #240 On Thomasnet.com

In this experiment, two different positions of the View Catalog button were compared. In version A the button was smaller and on the right. In version B the button was wider and more central. (The actual test was inverted before publishing to match the A-B of the pattern.)

Test #234 on by Alex James   Apr 01, 2019 Desktop Listing

Alex James Tested Pattern #101: Search Keyword Highlighting In Test #234

In this experiment, a different style for keyword highlighting was used.

Test #230 on Goodui.org by Jakub Linowski   Mar 09, 2019 Desktop Mobile Listing

Jakub Linowski Tested Pattern #56: Hover Button In Test #230 On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #222 on Thomasnet.com by Julian Gaviria   Feb 01, 2019 Desktop Listing

Julian Gaviria Tested Pattern #7: Social Counts In Test #222 On Thomasnet.com

In this variation, a number of social proof references were added to a signup modal.

Test #220 on by Alex James   Jan 18, 2019 Desktop Listing

Alex James Tested Pattern #34: Open In A New Tab In Test #220

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto   Dec 21, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #92: Already Viewed Label In Test #215 On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto   Nov 12, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #34: Open In A New Tab In Test #209 On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria   Nov 02, 2018 Desktop Mobile Listing

Julian Gaviria Tested Pattern #88: Action Button In Test #208 On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #196 on Vivareal.com.br by Vinicius Barros Peixoto   Aug 14, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #80: Persistent Filters In Test #196 On Vivareal.com.br

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Test #156 on Mt.com by Vito Mediavilla   Feb 25, 2018 Desktop Listing

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On Mt.com

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #133 on Bing.com by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.