All Latest 633 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #210 on Bomgar.com by Lee Elkins Nov 13, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

In this experiment, the header navigation links were removed on a landing page in order to provide more focus to the signup form.

Total Sample: 13,871 • Statistical Power at 5% MDE: 6.3%

Test #205 on Msn.com by Ronny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Engagement

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

In this experiment, the carousel items were increased from 12 to 16.

Test #9 on by Rick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

In this experiment, a "How It Works" content section was removed.

Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #199 on Freshegg.co.uk by Luke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #194 on Bomgar.com by Lee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #188 on Thomasnet.com by Julian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.

Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #186 on by Devesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

In this experiment, additional product categories were added at the top of the navigation.

Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Test #184 on Bomgar.com by Lee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Test #173 on Rollbar.com by Mike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

Total Sample: 8,433 • Statistical Power at 5% MDE: 4.3%

Test #170 on Goodui.org by Jakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #166 on Olark.com by Sunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #162 on Bullymax.com by Viljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales