All Latest 401 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #223 on Volders.de by Alexander Krieger   Feb 01, 2019 Desktop Mobile Signup

Alexander Krieger Tested Pattern #12: Payment First In Test #223 On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi   Jan 27, 2019 Desktop Product

Ronny Kohavi Tested Pattern #49: Above The Fold Call To Action In Test #221 On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James   Jan 18, 2019 Desktop Listing

Alex James Tested Pattern #34: Open In A New Tab In Test #220

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #218 on Yummly.com by Kimberly Cheung   Jan 14, 2019 Desktop Mobile Home & Landing

Kimberly Cheung Tested Pattern #94: Visible Search In Test #218 On Yummly.com

Hypothesis: Anonymous users can't use global search while on the home promo page. We believe that if we show a global search bar to anonymous users, it presents a higher converting funnel (guided search) and will increase our sign-up rates significantly.

Control (A): Logged out users don't see global search bar.

Variant (B): Logged out users see global search bar. After searching for a keyword, the signup funnel starts with a more personalized reason to continue the signup process.

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto   Dec 21, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #92: Already Viewed Label In Test #215 On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #216 on Support.microsoft.co... by Ronny Kohavi   Dec 21, 2018 Desktop Home & Landing

Ronny Kohavi Tested Pattern #2: Icon Labels In Test #216 On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #214 on Yummly.com by Marcos Ciarrocchi   Dec 07, 2018 Mobile Signup

Marcos Ciarrocchi Tested Pattern #91: Forced Action In Test #214 On Yummly.com

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #212 on Mt.com by Vito Mediavilla   Dec 04, 2018 Desktop Mobile Product

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #212 On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Test #213 on Mt.com by Vito Mediavilla   Dec 04, 2018 Desktop Mobile Signup

Vito Mediavilla Tested Pattern #85: Benefit Button In Test #213 On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #211 on Skype App by Ronny Kohavi   Nov 20, 2018 Mobile Global

Ronny Kohavi Tested Pattern #2: Icon Labels In Test #211

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #210 on Bomgar.com by Lee Elkins   Nov 13, 2018 Desktop Mobile Home & Landing

Lee Elkins Tested Pattern #64: Tunnel In Test #210 On Bomgar.com

In this experiment, the header navigation links were removed on a landing page in order to provide more focus to the signup form.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto   Nov 12, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #34: Open In A New Tab In Test #209 On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria   Nov 02, 2018 Desktop Mobile Listing

Julian Gaviria Tested Pattern #88: Action Button In Test #208 On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #207 on Suzuki.be by Karl Gilis   Nov 01, 2018 Desktop Product

Karl Gilis Tested Pattern #88: Action Button In Test #207 On Suzuki.be

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Test #205 on Msn.com by Ronny Kohavi   Oct 25, 2018 Desktop Home & Landing

Ronny Kohavi Tested Pattern #36: Fewer Or More Results In Test #205 On Msn.com

In this experiment, the carousel items were increased from 12 to 16.

Test #206 on Yummly.com by Kimberly Cheung   Oct 25, 2018 Desktop Mobile Signup

Kimberly Cheung Tested Pattern #40: Blurred Product Background In Test #206 On Yummly.com

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Test #204 on Kenhub.com by Niels Hapke   Oct 11, 2018 Desktop Mobile Global

Niels Hapke Tested Pattern #85: Benefit Button In Test #204 On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".