All Latest 633 A/B Tests

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

- Variant A
- Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #204 on Kenhub.com by Niels HapkeNiels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

- Variant A
- Variant B

In the variation, the "Help" section was reworded to "How to study".
Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #203 on Driving-tests.org by Andrei ZakhareuskiAndrei Zakhareuski Oct 10, 2018 Desktop Global X.X% Sales

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

- Variant A
- Variant B

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".
Total Sample: 67,451 • Statistical Power at 5% MDE: 3.9%

Test #202 on Kenhub.com by Niels HapkeNiels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

- Variant A
- Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.
Total Sample: 2,884 • Statistical Power at 5% MDE: 49.4%

Test #201 on by Ben LabayBen Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

- Variant A
- Variant B

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.
Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will AndersonWill Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

- Variant A
- Variant B

In this experiment, a "How It Works" content section was removed.
Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #197 on Reverb.com by Nicholas EvansNicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

- Variant A
- Variant B

In the variation, customer reviews were exposed from a less visible tab view.
Total Sample: 223,110 • Statistical Power at 5% MDE: 85.3%

Test #192 on Refactoring.guru by Alexander ShvetsAlexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Sales

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

- Variant A
- Variant B

In this experiment, a number of customer reviews were added at the middle of a product page.
Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #190 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

- Variant A
- Variant B

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.
Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

- Variant A
- Variant B
Total Sample: 96,195 • Statistical Power at 5% MDE: 48.2%

Test #187 on Trydesignlab.com by Will AndersonWill Anderson Jul 09, 2018 Desktop Mobile Product X.X% Sales

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

- Variant A
- Variant B

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits. 
Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%

Test #186 on by Devesh KhanalDevesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

- Variant A
- Variant B

In this experiment, additional product categories were added at the top of the navigation.
Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Test #180 on Radhabeauty.com by Viljo VabritViljo Vabrit Jun 03, 2018 Mobile Global X.X% Sales

Viljo Tested Pattern #45: Benefit Bar On Radhabeauty.com

- Variant A
- Variant B
Total Sample: 17,926 • Statistical Power at 5% MDE: 12.2%

Test #178 on by Devesh KhanalDevesh Khanal May 17, 2018 Desktop Product X.X% Sales

Devesh Tested Pattern #66: Complementary Upsell

- Variant A
- Variant B
Total Sample: 63,410 • Statistical Power at 5% MDE: 9.7%

Test #176 on Kenhub.com by Niels HapkeNiels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

- Variant A
- Variant B

In this experiment, testimonials were added on a checkout screen.
Total Sample: 3,333 • Statistical Power at 5% MDE: 49.3%

Test #174 on Examine.com by Martin WongMartin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

- Variant A
- Variant B
Total Sample: 1,702 • Statistical Power at 5% MDE: 8.3%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

- Variant A
- Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #167 on Lovehoney.co.uk by Matthew CurryMatthew Curry Apr 10, 2018 Desktop Product X.X% Sales

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

- Variant A
- Variant B

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #166 on Olark.com by Sunir ShahSunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

- Variant A
- Variant B

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).
Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

- Variant A
- Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%