All Latest 644 A/B Tests

MOST RECENT TESTS

Test #207 on Suzuki.be by Karl GilisKarl Gilis Nov 01, 2018 Desktop Product X.X% Progression

Karl Tested Pattern #88: Action Button On Suzuki.be

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #205 on Msn.com by Ronny KohaviRonny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Engagement

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B

In this experiment, the carousel items were increased from 12 to 16.

Test #206 on Yummly.com by Kimberly CheungKimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

Pattern #40: Blurred Product Background - Variant A
Pattern #40: Blurred Product Background - Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.
Total Sample: 138,106 • Statistical Power at 5% MDE: 77.4%

Test #204 on Kenhub.com by Niels HapkeNiels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In the variation, the "Help" section was reworded to "How to study".
Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #203 on Driving-tests.org by Andrei ZakhareuskiAndrei Zakhareuski Oct 10, 2018 Desktop Global X.X% Sales

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".
Total Sample: 67,451 • Statistical Power at 5% MDE: 3.9%

Test #202 on Kenhub.com by Niels HapkeNiels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

Pattern #13: Centered Forms &amp; Buttons - Variant A
Pattern #13: Centered Forms &amp; Buttons - Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.
Total Sample: 2,884 • Statistical Power at 5% MDE: 49.4%

Test #9 by Rick DawsonRick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Pattern #83: Progressive Fields - Variant A
Pattern #83: Progressive Fields - Variant B
Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #201 by Ben LabayBen Labay Sep 19, 2018 Desktop Mobile Thank You X.X% Sales

Ben Tested Pattern #7: Social Counts

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this test the upsell modal had an added text box with number of people that day who took the offer. The test hypothesis was that social proof will add motivation to take an action and the offer.
Total Sample: 59,003 • Statistical Power at 5% MDE: 47.9%

Test #200 on Trydesignlab.com by Will AndersonWill Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Sales

Will Tested Pattern #52: How It Works On Trydesignlab.com

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B

In this experiment, a "How It Works" content section was removed.
Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #199 on Freshegg.co.uk by Luke HayLuke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #197 on Reverb.com by Nicholas EvansNicholas Evans Sep 04, 2018 Desktop Product X.X% Sales

Nicholas Tested Pattern #4: Testimonials On Reverb.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In the variation, customer reviews were exposed from a less visible tab view.
Total Sample: 223,110 • Statistical Power at 5% MDE: 85.3%

Test #198 on Bomgar.com by Lee ElkinsLee Elkins Sep 03, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #40: Blurred Product Background On Bomgar.com

Pattern #40: Blurred Product Background - Variant A
Pattern #40: Blurred Product Background - Variant B
Total Sample: 1,893 • Statistical Power at 5% MDE: 21.3%

Test #195 on Yummly.com by Kimberly CheungKimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B
Total Sample: 371,274 • Statistical Power at 5% MDE: 99.9%

Test #194 on Bomgar.com by Lee ElkinsLee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #192 on Refactoring.guru by Alexander ShvetsAlexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Sales

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a number of customer reviews were added at the middle of a product page.
Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #193 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

Pattern #91: Forced Action - Variant A
Pattern #91: Forced Action - Variant B

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.
Total Sample: 1,335,347 • Statistical Power at 5% MDE: 99.9%

Test #189 on Yummly.com by Kimberly CheungKimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B
Total Sample: 259,933 • Statistical Power at 5% MDE: 98.8%

Test #188 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.
Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #187 on Trydesignlab.com by Will AndersonWill Anderson Jul 09, 2018 Desktop Mobile Product X.X% Sales

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

Pattern #71: Personalized Next Step - Variant A
Pattern #71: Personalized Next Step - Variant B

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits. 
Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%