All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A

Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Total Sample: 26,467 • Statistical Power at 5% MDE: 9.7%

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Leads

Vito Tested Pattern #85: Benefit Button On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Total Sample: 26,639 • Statistical Power at 5% MDE: 12.8%

Test #210 on Bomgar.com by Lee Elkins Nov 13, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

In this experiment, the header navigation links were removed on a landing page in order to provide more focus to the signup form.

Total Sample: 13,871 • Statistical Power at 5% MDE: 6.3%

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Total Sample: 39,170 • Statistical Power at 5% MDE: 7.2%

Test #207 on Suzuki.be by Karl Gilis Nov 01, 2018 Desktop Product X.X% Progression

Karl Tested Pattern #88: Action Button On Suzuki.be

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Test #49 on Menufy.com by Aleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #205 on Msn.com by Ronny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Engagement

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

Pattern #36: Fewer Or More Results - Variant A

Pattern #36: Fewer Or More Results - Variant B

In this experiment, the carousel items were increased from 12 to 16.

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

Pattern #40: Blurred Product Background - Variant A

Pattern #40: Blurred Product Background - Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Total Sample: 138,106 • Statistical Power at 5% MDE: 77.4%

Test #204 on Kenhub.com by Niels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".

Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #203 on Driving-tests.org by Andrei Zakhareuski Oct 10, 2018 Desktop Global X.X% Sales

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".

Total Sample: 67,451 • Statistical Power at 5% MDE: 3.9%

Test #202 on Kenhub.com by Niels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

Pattern #13: Centered Forms & Buttons - Variant A

Pattern #13: Centered Forms & Buttons - Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.

Total Sample: 2,884 • Statistical Power at 5% MDE: 49.4%

Test #9 by Rick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Pattern #83: Progressive Fields - Variant A

Pattern #83: Progressive Fields - Variant B

Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #201 by Ben Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales