All Latest 644 A/B Tests

MOST RECENT TESTS

Test #217 on Thomasnet.com by Julian GaviriaJulian Gaviria Jan 03, 2019 Desktop Mobile Home & Landing X.X% Engagement

Julian Tested Pattern #41: Sticky Call To Action On Thomasnet.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B
Total Sample: 158,023 • Statistical Power at 5% MDE: 8.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #216 on Support.microsoft.co... by Ronny KohaviRonny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #210 on Bomgar.com by Lee ElkinsLee Elkins Nov 13, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, the header navigation links were removed on a landing page in order to provide more focus to the signup form.
Total Sample: 13,871 • Statistical Power at 5% MDE: 6.3%

Test #205 on Msn.com by Ronny KohaviRonny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Engagement

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B

In this experiment, the carousel items were increased from 12 to 16.

Test #9 by Rick DawsonRick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Pattern #83: Progressive Fields - Variant A
Pattern #83: Progressive Fields - Variant B
Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #200 on Trydesignlab.com by Will AndersonWill Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B

In this experiment, a "How It Works" content section was removed.
Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #199 on Freshegg.co.uk by Luke HayLuke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #194 on Bomgar.com by Lee ElkinsLee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #188 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.
Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #186 by Devesh KhanalDevesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this experiment, additional product categories were added at the top of the navigation.
Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Test #184 on Bomgar.com by Lee ElkinsLee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Test #173 on Rollbar.com by Mike SmithMike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 8,433 • Statistical Power at 5% MDE: 4.3%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #166 on Olark.com by Sunir ShahSunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Pattern #12: Payment First - Variant A
Pattern #12: Payment First - Variant B

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).
Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #162 on Bullymax.com by Viljo VabritViljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

Pattern #68: Welcome Discount - Variant A
Pattern #68: Welcome Discount - Variant B
Total Sample: 14,865 • Statistical Power at 5% MDE: 8.4%

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%

Test #153 on Goodui.org by Jakub LinowskiJakub Linowski Feb 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #58: Full Height False Bottom On Goodui.org

Pattern #58: Full Height False Bottom - Variant A
Pattern #58: Full Height False Bottom - Variant B
Total Sample: 11,330 • Statistical Power at 5% MDE: 8.6%

Test #150 on Normanrecords.com by Nathon RaineNathon Raine Feb 07, 2018 Desktop Home & Landing X.X% Sales

Nathon Tested Pattern #45: Benefit Bar On Normanrecords.com

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 120,700 • Statistical Power at 5% MDE: 35.2%

Test #148 on Kenhub.com by Niels HapkeNiels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

Pattern #53: Problem-Solution Headline - Variant A
Pattern #53: Problem-Solution Headline - Variant B
Total Sample: 49,448 • Statistical Power at 5% MDE: 74.3%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%