All Latest 610 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #219 on Mt.com by Vito Mediavilla Jan 14, 2019 Desktop Mobile Home & Landing

Vito Tested Pattern #95: Clickable Product Previews On Mt.com

Test #217 on Thomasnet.com by Julian Gaviria Jan 03, 2019 Desktop Mobile Home & Landing

Julian Tested Pattern #41: Sticky Call To Action On Thomasnet.com

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto Dec 21, 2018 Mobile Listing

Vinicius Tested Pattern #92: Already Viewed Label On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #207 on Suzuki.be by Karl Gilis Nov 01, 2018 Desktop Product

Karl Tested Pattern #88: Action Button On Suzuki.be

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Test #201 on by Ben Labay Sep 19, 2018 Desktop Mobile Thank You

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Test #197 on Reverb.com by Nicholas Evans Sep 04, 2018 Desktop Product

Nicholas Tested Pattern #4: Testimonials On Reverb.com

In the variation, customer reviews were exposed from a less visible tab view.

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Test #188 on Thomasnet.com by Julian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing