All Latest 634 A/B Tests

Test #106 on Examine.com by Martin WongMartin Wong May 23, 2017 Desktop Product X.X% Progression

Martin Tested Pattern #15: Bulleted Reassurances On Examine.com

 - Variant A
 - Variant B

Three reassurances were added underneath each purchase button: Lifetime Updates, Works On All Devices and Money-Back Guarantee.

Total Sample: 10,576 Statistical Power at 5% MDE: 6.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #107 on Examine.com by Martin WongMartin Wong May 22, 2017 Desktop Product X.X% Progression

Martin Tested Pattern #14: Exposed Menu Options On Examine.com

 - Variant A
 - Variant B
Total Sample: 10,662 Statistical Power at 5% MDE: 6.8%

Test #97 on 3dhubs.com by Rob DraaijerRob Draaijer May 03, 2017 Desktop Mobile Listing X.X% Progression

Rob Tested Pattern #24: Visible Availability On 3dhubs.com

 - Variant A
 - Variant B
Total Sample: 13,441 Statistical Power at 5% MDE: 14.5%

Test #101 on Acousticalsurfaces.c... by Julian GaviriaJulian Gaviria May 02, 2017 Desktop Mobile Content X.X% Progression

Julian Tested Pattern #23: Inline Link Nudge On Acousticalsurfaces.c...

 - Variant A
 - Variant B
Total Sample: 10,258 Statistical Power at 5% MDE: 4.2%

Test #96 on 3dhubs.com by Rob DraaijerRob Draaijer Apr 21, 2017 Desktop Mobile Home & Landing X.X% Progression

Rob Tested Pattern #61: Local Headline On 3dhubs.com

 - Variant A
 - Variant B
Total Sample: 20,274 Statistical Power at 5% MDE: 14.5%

Test #88 on Ssdnodes.com by Matt ConnorMatt Connor Mar 31, 2017 Desktop Mobile Shopping Cart X.X% Progression

Matt Tested Pattern #21: What It's Worth On Ssdnodes.com

 - Variant A
 - Variant B
Total Sample: 2,306 Statistical Power at 5% MDE: 14.5%

Test #83 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Mar 02, 2017 Desktop Home & Landing X.X% Progression

Jaymie Tested Pattern #4: Testimonials On Onlinefaxes.com

 - Variant A
 - Variant B
Total Sample: 25,482 Statistical Power at 5% MDE: 36%

Test #84 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Mar 02, 2017 Desktop Mobile Home & Landing X.X% Progression

Jaymie Tested Pattern #7: Social Counts On Onlinefaxes.com

 - Variant A
 - Variant B
Total Sample: 25,610 Statistical Power at 5% MDE: 36.2%

Test #46 on Hylokusa.com by Julian GaviriaJulian Gaviria Feb 01, 2017 Desktop Product X.X% Progression

Julian Tested Pattern #60: Repeated Bottom Call To Action On Hylokusa.com

 - Variant A
 - Variant B
Total Sample: 1,416 Statistical Power at 5% MDE: 4.5%

Test #82 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 17, 2017 Desktop Mobile Home & Landing X.X% Progression

Pierre Olivier Tested Pattern #10: Postponed Modal Forms On Poll-app.com

 - Variant A
 - Variant B
Total Sample: 21,762 Statistical Power at 5% MDE: 80.4%

Test #74 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 07, 2017 Desktop Home & Landing X.X% Progression

Pierre Olivier Tested Pattern #22: Empowering Headline On Poll-app.com

 - Variant A
 - Variant B
Total Sample: 7,217 Statistical Power at 5% MDE: 41%

Test #92 on Rollbar.com by Mike SmithMike Smith Jan 02, 2017 Desktop Mobile Home & Landing X.X% Progression

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

 - Variant A
 - Variant B
Total Sample: 10,179 Statistical Power at 5% MDE: 7.3%

Test #63 on Vanityplanet.com by Doug BaltmanDoug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

 - Variant A
 - Variant B
Total Sample: 6,000 Statistical Power at 5% MDE: 7.6%

Test #64 on Goodui.org by Jakub LinowskiJakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Progression

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

 - Variant A
 - Variant B

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.

Total Sample: 35,058 Statistical Power at 5% MDE: 11.2%

Test #91 on 3dhubs.com by Rob DraaijerRob Draaijer Jan 01, 2017 Desktop Listing X.X% Progression

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

 - Variant A
 - Variant B

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.

Total Sample: 54,916 Statistical Power at 5% MDE: 54.3%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Progression

Herman Tested Pattern #4: Testimonials On Adoramapix.com

 - Variant A
 - Variant B
Total Sample: 19,399 Statistical Power at 5% MDE: 48.7%

Test #55 on Autodesk.com by Lisa SeamanLisa Seaman Aug 11, 2016 Desktop Home & Landing X.X% Progression

Lisa Tested Pattern #14: Exposed Menu Options On Autodesk.com

 - Variant A
 - Variant B

In this test, some of the menu options (accessible in the top right hamburger menu) were copied over onto the top navigation. The options that were exposed were "All Products", "Free Trial" and "Buy".

Total Sample: 453,820 Statistical Power at 5% MDE: 99.9%

Test #16 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B
Total Sample: 25,584 Statistical Power at 5% MDE: 9.5%

Test #17 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B
Total Sample: 25,344 Statistical Power at 5% MDE: 9.4%

Test #18 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B

This is a retest of Test017 with a lengthier testing duration.

Total Sample: 241,695 Statistical Power at 5% MDE: 23.8%