All Latest 610 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #210 on Bomgar.com by Lee Elkins Nov 13, 2018 Desktop Mobile Home & Landing

Lee Tested Pattern #64: Tunnel On Bomgar.com

In this experiment, the header navigation links were removed on a landing page in order to provide more focus to the signup form.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto Nov 12, 2018 Mobile Listing

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #49 on Menufy.com by Aleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Test #204 on Kenhub.com by Niels Hapke Oct 11, 2018 Desktop Mobile Global

Niels Tested Pattern #85: Benefit Button On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".

Test #202 on Kenhub.com by Niels Hapke Oct 01, 2018 Desktop Mobile Checkout

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.

Test #9 on by Rick Dawson Sep 28, 2018 Desktop Mobile Home & Landing

Rick Tested Pattern #83: Progressive Fields

Test #201 on by Ben Labay Sep 19, 2018 Desktop Mobile Thank You

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing

Will Tested Pattern #52: How It Works On Trydesignlab.com

In this experiment, a "How It Works" content section was removed.

Test #199 on Freshegg.co.uk by Luke Hay Sep 13, 2018 Desktop Mobile Home & Landing

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #196 on Vivareal.com.br by Vinicius Barros Peixoto Aug 14, 2018 Mobile Listing

Vinicius Tested Pattern #80: Persistent Filters On Vivareal.com.br

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Test #194 on Bomgar.com by Lee Elkins Aug 08, 2018 Desktop Mobile Home & Landing

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global