All Latest 633 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #9 on by Rick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #201 on by Ben Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.

Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

In this experiment, a "How It Works" content section was removed.

Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #199 on Freshegg.co.uk by Luke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #197 on Reverb.com by Nicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

In the variation, customer reviews were exposed from a less visible tab view.

Total Sample: 223,110 • Statistical Power at 5% MDE: 85.3%

Test #198 on Bomgar.com by Lee Elkins Sep 03, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #40: Blurred Product Background On Bomgar.com

Total Sample: 1,893 • Statistical Power at 5% MDE: 21.3%

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Total Sample: 371,274 • Statistical Power at 5% MDE: 99.9%

Test #194 on Bomgar.com by Lee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Total Sample: 1,335,347 • Statistical Power at 5% MDE: 99.9%

Test #192 on Refactoring.guru by Alexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Sales

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

In this experiment, a number of customer reviews were added at the middle of a product page.

Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #189 on Yummly.com by Kimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Total Sample: 259,933 • Statistical Power at 5% MDE: 98.8%

Test #188 on Thomasnet.com by Julian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.

Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #187 on Trydesignlab.com by Will Anderson Jul 09, 2018 Desktop Mobile Product X.X% Sales

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits.

Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%

Test #184 on Bomgar.com by Lee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups