All Latest 645 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #237 on Goodui.org by Jakub Linowski Apr 29, 2019 Desktop Mobile Listing X.X% Sales

Jakub Tested Pattern #103: Money Back Guarantee On Goodui.org

Pattern #103: Money Back Guarantee - Variant A

Pattern #103: Money Back Guarantee - Variant B

Total Sample: 21,096 • Statistical Power at 5% MDE: 6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout X.X% Sales

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

Pattern #6: Customer Star Ratings - Variant A

Pattern #6: Customer Star Ratings - Variant B

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Total Sample: 20,661 • Statistical Power at 5% MDE: 30.3%

Test #229 by Jakub Linowski Mar 08, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

Total Sample: 11,214 • Statistical Power at 5% MDE: 13%

Test #228 by Jakub Linowski Mar 05, 2019 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

The variation added a progress bar to one of the checkout steps for a ticket ordering site.

Total Sample: 12,961 • Statistical Power at 5% MDE: 14.7%

Test #222 on Thomasnet.com by Julian Gaviria Feb 01, 2019 Desktop Listing X.X% Leads

Julian Tested Pattern #7: Social Counts On Thomasnet.com

In this variation, a number of social proof references were added to a signup modal.

Total Sample: 34,676 • Statistical Power at 5% MDE: 47.1%

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A

Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Total Sample: 26,467 • Statistical Power at 5% MDE: 9.7%

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global X.X% Progression

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #204 on Kenhub.com by Niels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".

Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #201 by Ben Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

In this experiment, a "How It Works" content section was removed.

Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #197 on Reverb.com by Nicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

In the variation, customer reviews were exposed from a less visible tab view.

Total Sample: 223,110 • Statistical Power at 5% MDE: 85.3%

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Pattern #78: Tags, Badges And Structured Information - Variant A

Pattern #78: Tags, Badges And Structured Information - Variant B

Total Sample: 371,274 • Statistical Power at 5% MDE: 99.9%

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Sales

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales