All Latest 650 A/B Tests

Test #46 on Hylokusa.com by Julian GaviriaJulian Gaviria Feb 01, 2017 Desktop Product X.X% Progression

Julian Tested Pattern #60: Repeated Bottom Call To Action On Hylokusa.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B
Total Sample: 1,416 • Statistical Power at 5% MDE: 4.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #82 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 17, 2017 Desktop Mobile Home & Landing X.X% Progression

Pierre Olivier Tested Pattern #10: Postponed Modal Forms On Poll-app.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B
Total Sample: 21,762 • Statistical Power at 5% MDE: 80.4%

Test #74 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 07, 2017 Desktop Home & Landing X.X% Progression

Pierre Olivier Tested Pattern #22: Empowering Headline On Poll-app.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 7,217 • Statistical Power at 5% MDE: 41%

Test #92 on Rollbar.com by Mike SmithMike Smith Jan 02, 2017 Desktop Mobile Home & Landing X.X% Progression

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 10,179 • Statistical Power at 5% MDE: 7.3%

Test #63 on Vanityplanet.com by Doug BaltmanDoug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B
Total Sample: 6,000 • Statistical Power at 5% MDE: 7.6%

Test #64 on Goodui.org by Jakub LinowskiJakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Progression

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.

Total Sample: 35,058 • Statistical Power at 5% MDE: 11.2%

Test #91 on 3dhubs.com by Rob DraaijerRob Draaijer Jan 01, 2017 Desktop Listing X.X% Progression

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.

Total Sample: 54,916 • Statistical Power at 5% MDE: 54.3%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Progression

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 19,399 • Statistical Power at 5% MDE: 48.7%

Test #55 on Autodesk.com by Lisa SeamanLisa Seaman Aug 11, 2016 Desktop Home & Landing X.X% Progression

Lisa Tested Pattern #14: Exposed Menu Options On Autodesk.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this test, some of the menu options (accessible in the top right hamburger menu) were copied over onto the top navigation. The options that were exposed were "All Products", "Free Trial" and "Buy".

Total Sample: 453,820 • Statistical Power at 5% MDE: 99.9%

Test #16 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B
Total Sample: 25,584 • Statistical Power at 5% MDE: 9.5%

Test #17 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B
Total Sample: 25,344 • Statistical Power at 5% MDE: 9.4%

Test #18 on Caffeineinformer.com by James FosterJames Foster Jul 01, 2016 Mobile Home & Landing X.X% Progression

James Tested Pattern #2: Icon Labels On Caffeineinformer.com

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B

This is a retest of Test017 with a lengthier testing duration.

Total Sample: 241,695 • Statistical Power at 5% MDE: 23.8%

Test #47 on Adoramapix.com by Herman KleinHerman Klein Jun 09, 2016 Desktop Shopping Cart X.X% Progression

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 3,083 • Statistical Power at 5% MDE: 59.9%

Test #42 on Adoramapix.com by Herman KleinHerman Klein May 11, 2016 Shopping Cart X.X% Progression

Herman Tested Pattern #1: Remove Coupon Fields On Adoramapix.com

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B
Total Sample: 15,516 • Statistical Power at 5% MDE: 99.8%

Test #38 on Mt.com by Vito MediavillaVito Mediavilla May 01, 2016 Desktop Product X.X% Progression

Vito Tested Pattern #10: Postponed Modal Forms On Mt.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B
Total Sample: 13,526 • Statistical Power at 5% MDE: 9.2%

Test #37 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Apr 09, 2016 Desktop Mobile Home & Landing X.X% Progression

Jaymie Tested Pattern #27: More For Less Headline On Onlinefaxes.com

Pattern #27: More For Less Headline - Variant A
Pattern #27: More For Less Headline - Variant B
Total Sample: 21,822 • Statistical Power at 5% MDE: 11.1%

Test #27 on Adoramapix.com by Herman KleinHerman Klein Mar 01, 2016 Desktop Mobile Product X.X% Progression

Herman Tested Pattern #11: Gradual Reassurance On Adoramapix.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 1,244 • Statistical Power at 5% MDE: 5.8%

Test #21 on Findsomeone.co.nz by Daniel BridgesDaniel Bridges Jan 01, 2016 Desktop Mobile Listing X.X% Progression

Daniel Tested Pattern #25: Nagging Results On Findsomeone.co.nz

Pattern #25: Nagging Results - Variant A
Pattern #25: Nagging Results - Variant B
Total Sample: 55,182 • Statistical Power at 5% MDE: 10.6%

Test #60 on Embracepetinsurance.... by Matt AsterMatt Aster Sep 30, 2015 Desktop Home & Landing X.X% Progression

Matt Tested Pattern #8: Natural Language Forms On Embracepetinsurance....

Pattern #8: Natural Language Forms - Variant A
Pattern #8: Natural Language Forms - Variant B
Total Sample: 12,102 • Statistical Power at 5% MDE: 60.3%

Test #6 on Runrun.it by Franklin ValadaresFranklin Valadares Sep 15, 2015 Desktop Mobile Home & Landing X.X% Progression

Franklin Tested Pattern #85: Benefit Button On Runrun.it

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B
Total Sample: 9,618 • Statistical Power at 5% MDE: 14.3%