All Latest 645 A/B Tests

Test #64 on Goodui.org by Jakub LinowskiJakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.
Total Sample: 35,058 • Statistical Power at 5% MDE: 11.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #63 on Vanityplanet.com by Doug BaltmanDoug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B
Total Sample: 6,000 • Statistical Power at 5% MDE: 7.6%

Test #51 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 20, 2016 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #63: Trust Seals On Menufy.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 14,269 • Statistical Power at 5% MDE: 99.9%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 19,399 • Statistical Power at 5% MDE: 48.7%

Test #55 on Autodesk.com by Lisa SeamanLisa Seaman Aug 11, 2016 Desktop Home & Landing X.X% Progression

Lisa Tested Pattern #14: Exposed Menu Options On Autodesk.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this test, some of the menu options (accessible in the top right hamburger menu) were copied over onto the top navigation. The options that were exposed were "All Products", "Free Trial" and "Buy".
Total Sample: 453,820 • Statistical Power at 5% MDE: 99.9%

Test #54 by Chris GowardChris Goward Aug 11, 2016 Desktop Mobile Product X.X% Leads

Chris Tested Pattern #7: Social Counts

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

Client background (e.g. industry, business model):

This client is a healthcare company: their website is designed for lead generation. This company collects leads for their kidney-focused programs and ultimately provides kidney dialysis for those who decide to become patients.

 

Experiment background:

This experiment was focused on a right rail and the goal was to encourage more users to sign up to download the client’s free diabetes-friendly cookbook.
Total Sample: 95,073 • Statistical Power at 5% MDE: 12.4%

Test #57 by Jakub LinowskiJakub Linowski Jul 07, 2016 Desktop Checkout X.X% Sales

Jakub Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B
Total Sample: 6,079 • Statistical Power at 5% MDE: 12.5%

Test #47 on Adoramapix.com by Herman KleinHerman Klein Jun 09, 2016 Desktop Shopping Cart X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 3,083 • Statistical Power at 5% MDE: 59.9%

Test #35 by Someone Someone Apr 01, 2016 Desktop Mobile Home & Landing X.X% Sales

Someone Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B
Total Sample: 37,741 • Statistical Power at 5% MDE: 11.9%

Test #27 on Adoramapix.com by Herman KleinHerman Klein Mar 01, 2016 Desktop Mobile Product X.X% Sales

Herman Tested Pattern #11: Gradual Reassurance On Adoramapix.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 1,244 • Statistical Power at 5% MDE: 5.8%

Test #34 on Theorytestpro.co.uk by Henry DillonHenry Dillon Mar 01, 2016 Desktop Home & Landing X.X% Signups

Henry Tested Pattern #11: Gradual Reassurance On Theorytestpro.co.uk

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 7,507 • Statistical Power at 5% MDE: 14.1%

Test #2 on Wpallimport.com by Louis ReingoldLouis Reingold Jan 01, 2016 Desktop Pricing X.X% Sales

Louis Tested Pattern #21: What It's Worth On Wpallimport.com

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B
Total Sample: 7,009 • Statistical Power at 5% MDE: 9.4%

Test #12 on Covenanteyes.com by Nicole MorrisNicole Morris Dec 01, 2015 Desktop Mobile Home & Landing X.X% Sales

Nicole Tested Pattern #29: Surfaced Content On Covenanteyes.com

Pattern #29: Surfaced Content - Variant A
Pattern #29: Surfaced Content - Variant B

In the B variation, 3 blog posts were referenced at the bottom of the homepage. Each of the blog post articles also contained strong copy to present the problem the service was helping customers with (porn addition) - along with clear calls to start a subscription (the primary metric).
Total Sample: 26,652 • Statistical Power at 5% MDE: 12.2%

Test #23 on Checkineasy.com by Justin BaerJustin Baer Oct 01, 2015 Desktop Mobile Home & Landing X.X% Signups

Justin Tested Pattern #52: How It Works On Checkineasy.com

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B
Total Sample: 4,743 • Statistical Power at 5% MDE: 8.7%

Test #53 by Someone Someone Aug 01, 2015 Desktop Home & Landing X.X% Sales

Someone Tested Pattern #6: Customer Star Ratings

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B
Total Sample: 117,360 • Statistical Power at 5% MDE: 13.8%

Test #43 on Embracepetinsurance.... by Matt AsterMatt Aster Aug 01, 2015 Desktop Mobile Home & Landing X.X% Sales

Matt Tested Pattern #6: Customer Star Ratings On Embracepetinsurance....

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B
Total Sample: 69,436 • Statistical Power at 5% MDE: 19.4%