All Latest 610 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup

Vito Tested Pattern #85: Benefit Button On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #207 on Suzuki.be by Karl Gilis Nov 01, 2018 Desktop Product

Karl Tested Pattern #88: Action Button On Suzuki.be

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Test #205 on Msn.com by Ronny Kohavi Oct 25, 2018 Desktop Home & Landing

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

In this experiment, the carousel items were increased from 12 to 16.

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Test #204 on Kenhub.com by Niels Hapke Oct 11, 2018 Desktop Mobile Global

Niels Tested Pattern #85: Benefit Button On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".

Test #203 on Driving-tests.org by Andrei Zakhareuski Oct 10, 2018 Desktop Global

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".

Test #9 on by Rick Dawson Sep 28, 2018 Desktop Mobile Home & Landing

Rick Tested Pattern #83: Progressive Fields

Test #199 on Freshegg.co.uk by Luke Hay Sep 13, 2018 Desktop Mobile Home & Landing

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

Test #188 on Thomasnet.com by Julian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing

Julian Tested Pattern #4: Testimonials On Thomasnet.com

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.

Test #187 on Trydesignlab.com by Will Anderson Jul 09, 2018 Desktop Mobile Product

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits.

Test #185 on Retrome.pl by Grzegorz Jancewicz Jul 03, 2018 Mobile Listing