All Latest 633 A/B Tests

Test #76 on Goodui.org by Jakub LinowskiJakub Linowski Feb 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #16: Welcome Mat - Partial On Goodui.org

 - Variant A
 - Variant B
Total Sample: 11,330 Statistical Power at 5% MDE: 5.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #82 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 17, 2017 Desktop Mobile Home & Landing X.X% Signups

Pierre Olivier Tested Pattern #10: Postponed Modal Forms On Poll-app.com

 - Variant A
 - Variant B
Total Sample: 21,762 Statistical Power at 5% MDE: 80.4%

Test #79 on by Chris GowardChris Goward Jan 10, 2017 Desktop Product X.X% Sales

Chris Tested Pattern #15: Bulleted Reassurances

 - Variant A
 - Variant B
Total Sample: 11,006 Statistical Power at 5% MDE: 21%

Test #74 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 07, 2017 Desktop Home & Landing X.X% Signups

Pierre Olivier Tested Pattern #22: Empowering Headline On Poll-app.com

 - Variant A
 - Variant B
Total Sample: 7,217 Statistical Power at 5% MDE: 41%

Test #92 on Rollbar.com by Mike SmithMike Smith Jan 02, 2017 Desktop Mobile Home & Landing X.X% Signups

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

 - Variant A
 - Variant B
Total Sample: 10,179 Statistical Power at 5% MDE: 7.3%

Test #91 on 3dhubs.com by Rob DraaijerRob Draaijer Jan 01, 2017 Desktop Listing X.X% Leads

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

 - Variant A
 - Variant B

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.

Total Sample: 54,916 Statistical Power at 5% MDE: 54.3%

Test #77 on Easycredit.se by Hugo PalmHugo Palm Dec 05, 2016 Desktop Mobile Signup X.X% Leads

Hugo Tested Pattern #5: Top Aligned Labels On Easycredit.se

 - Variant A
 - Variant B
Total Sample: 8,292 Statistical Power at 5% MDE: 94.8%

Test #66 on Telestream.net by Chris GowardChris Goward Nov 01, 2016 Shopping Cart X.X% Sales

Chris Tested Pattern #9: Multiple Steps On Telestream.net

 - Variant A
 - Variant B

Telestream specializes in software that make it possible to get video content to any audience regardless of how it is created, distributed, or viewed. Telestream’s customer acquisition strategy is centered around driving traffic to their website to trial, or to purchase from their online store. Shoppers can buy software online, download it right away, and immediately start using it. The variation was designed with the same information as the control except spread across 4 steps (instead of 3). The rationale was that each step would be shorter and less overwhelming for the user.

Total Sample: 7,610 Statistical Power at 5% MDE: 33.7%

Test #70 on Uptowork.com by Kuba KoziejKuba Koziej Nov 01, 2016 Desktop Pricing X.X% Revenue

Kuba Tested Pattern #17: Least Or Most Expensive First On Uptowork.com

 - Variant A
 - Variant B

This test simply ordered the pricing plans from highest to most expensive. Overall sales decreased by an insignificant -1% with a possible +14% increase to the most expensive plan. The net effect was an insignificant 0.9% increase the the premium plans.

Test #14 on Prizegrab.com by Greg Van HornGreg Van Horn Oct 20, 2016 Desktop Home & Landing X.X% Leads

Greg Tested Pattern #8: Natural Language Forms On Prizegrab.com

 - Variant A
 - Variant B
Total Sample: 3,133 Statistical Power at 5% MDE: 8.8%

Test #59 on by Someone Someone Oct 01, 2016 Home & Landing X.X% Leads

Someone Tested Pattern #8: Natural Language Forms

 - Variant A
 - Variant B
Total Sample: 3,716 Statistical Power at 5% MDE: 7.7%

Test #58 on Bingocardcreator.com by Patrick McKenziePatrick McKenzie Aug 26, 2016 Desktop Home & Landing X.X% Leads

Patrick Tested Pattern #8: Natural Language Forms On Bingocardcreator.com

 - Variant A
 - Variant B
Total Sample: 736 Statistical Power at 5% MDE: 6.3%

Test #69 on Digitalmarketer.com by Justin RondeauJustin Rondeau Aug 01, 2016 Desktop Mobile Home & Landing X.X% Signups

Justin Tested Pattern #10: Postponed Modal Forms On Digitalmarketer.com

 - Variant A
 - Variant B
Total Sample: 2,685 Statistical Power at 5% MDE: 20%

Test #16 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B
Total Sample: 25,584 Statistical Power at 5% MDE: 9.5%

Test #17 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B
Total Sample: 25,344 Statistical Power at 5% MDE: 9.4%

Test #18 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

 - Variant A
 - Variant B

This is a retest of Test017 with a lengthier testing duration.

Total Sample: 241,695 Statistical Power at 5% MDE: 23.8%

Test #38 on Mt.com by Vito MediavillaVito Mediavilla May 01, 2016 Desktop Product X.X% Leads

Vito Tested Pattern #10: Postponed Modal Forms On Mt.com

 - Variant A
 - Variant B
Total Sample: 13,526 Statistical Power at 5% MDE: 9.2%

Test #32 on Over-blog.com by Tael PinaultTael Pinault Apr 20, 2016 Desktop Signup X.X% Signups

Tael Tested Pattern #40: Blurred Product Background On Over-blog.com

 - Variant A
 - Variant B
Total Sample: 7,233 Statistical Power at 5% MDE: 38.1%

Test #37 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Apr 09, 2016 Desktop Mobile Home & Landing X.X% Sales

Jaymie Tested Pattern #27: More For Less Headline On Onlinefaxes.com

 - Variant A
 - Variant B
Total Sample: 21,822 Statistical Power at 5% MDE: 11.1%

Test #65 on Digitalmarketer.com by Justin RondeauJustin Rondeau Mar 01, 2016 Desktop Home & Landing X.X% Leads

Justin Tested Pattern #10: Postponed Modal Forms On Digitalmarketer.com

 - Variant A
 - Variant B
Total Sample: 5,788 Statistical Power at 5% MDE: 49.1%