All Latest 631 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Total Sample: 26,467 • Statistical Power at 5% MDE: 9.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #211 on Skype App by Ronny Kohavi Nov 20, 2018 Mobile Global X.X% Progression

Ronny Tested Pattern #2: Icon Labels

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #204 on Kenhub.com by Niels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

In the variation, the "Help" section was reworded to "How to study".

Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #201 on by Ben Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

In this experiment, a "How It Works" content section was removed.

Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #197 on Reverb.com by Nicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

In the variation, customer reviews were exposed from a less visible tab view.

Total Sample: 223,110 • Statistical Power at 5% MDE: 85.3%

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Total Sample: 371,274 • Statistical Power at 5% MDE: 99.9%

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Sales

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales