All Latest 649 A/B Tests

MOST RECENT TESTS

Test #171 on Sjvc.edu by Phillip BarnesPhillip Barnes Apr 27, 2018 Desktop Mobile Signup X.X% Leads

Phillip Tested Pattern #63: Trust Seals On Sjvc.edu

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 1,197 • Statistical Power at 5% MDE: 12.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #166 on Olark.com by Sunir ShahSunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Pattern #12: Payment First - Variant A
Pattern #12: Payment First - Variant B

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).
Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

Pattern #50: Autoplay Video - Variant A
Pattern #50: Autoplay Video - Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #163 on Lovehoney.co.uk by Matthew CurryMatthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Revenue

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%

Test #160 on Examine.com by Martin WongMartin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #158 on Kenhub.com by Niels HapkeNiels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #155 on Mt.com by Vito MediavillaVito Mediavilla Feb 22, 2018 Mobile Product X.X% Leads

Vito Tested Pattern #3: Fewer Form Fields On Mt.com

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B
Total Sample: 8,652 • Statistical Power at 5% MDE: 5.3%

Test #154 on Reverb.com by Nicholas EvansNicholas Evans Feb 20, 2018 Desktop Mobile Product X.X% Signups

Nicholas Tested Pattern #59: Inverted Or Consistent Button Styles On Reverb.com

Pattern #59: Inverted Or Consistent Button Styles - Variant A
Pattern #59: Inverted Or Consistent Button Styles - Variant B
Total Sample: 725,114 • Statistical Power at 5% MDE: 19.4%

Test #153 on Goodui.org by Jakub LinowskiJakub Linowski Feb 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #58: Full Height False Bottom On Goodui.org

Pattern #58: Full Height False Bottom - Variant A
Pattern #58: Full Height False Bottom - Variant B
Total Sample: 11,330 • Statistical Power at 5% MDE: 8.6%

Test #152 on Reverb.com by Nicholas EvansNicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #148 on Kenhub.com by Niels HapkeNiels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

Pattern #53: Problem-Solution Headline - Variant A
Pattern #53: Problem-Solution Headline - Variant B
Total Sample: 49,448 • Statistical Power at 5% MDE: 74.3%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #144 on Examine.com by Martin WongMartin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #27: More For Less Headline On Examine.com

Pattern #27: More For Less Headline - Variant A
Pattern #27: More For Less Headline - Variant B
Total Sample: 15,542 • Statistical Power at 5% MDE: 7.8%

Test #140 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product X.X% Leads

Grzegorz Tested Pattern #46: Pay Later On Akademiafotografii.p...

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".
Total Sample: 37,727 • Statistical Power at 5% MDE: 19.9%

Test #141 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jan 05, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #49: Above The Fold Call To Action On Trydesignlab.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

The variation introduced a call to action at the top of the screen that linked to a form deep down on a long course page.
Total Sample: 5,789 • Statistical Power at 5% MDE: 6.4%

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,258 • Statistical Power at 5% MDE: 8.2%