All Latest 620 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Test #238 on Suzuki.be by Karl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Join To See Winners And Estimate Your Tests

Test #231 on Glass.net by Mark Freedle Mar 14, 2019 Desktop Mobile Signup X.X% Progression

Mark Tested Pattern #20: Canned Response On Glass.net

Test #226 on Microsoft.com by Ronny Kohavi Feb 18, 2019 Desktop Product X.X% Progression

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 on by Devesh Khanal Feb 17, 2019 Desktop Product X.X% Progression

Devesh Tested Pattern #41: Sticky Call To Action

Test #224 on by Alex James Feb 11, 2019 Desktop Home & Landing X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

This experiment reduced the search form by removing the distance field.

Test #222 on Thomasnet.com by Julian Gaviria Feb 01, 2019 Desktop Listing X.X% Progression

Julian Tested Pattern #7: Social Counts On Thomasnet.com

In this variation, a number of social proof references were added to a signup modal.

Test #221 on Microsoft.com by Ronny Kohavi Jan 27, 2019 Desktop Product X.X% Progression

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Progression

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Progression

Vito Tested Pattern #85: Benefit Button On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global X.X% Progression

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Test #207 on Suzuki.be by Karl Gilis Nov 01, 2018 Desktop Product X.X% Progression

Karl Tested Pattern #88: Action Button On Suzuki.be

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Test #205 on Msn.com by Ronny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Progression