All Latest 644 A/B Tests

Test #199 on Freshegg.co.uk by Luke HayLuke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, standard (filled) buttons were tested against ghost buttons.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #195 on Yummly.com by Kimberly CheungKimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Progression

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B
Total Sample: 371,274 • Statistical Power at 5% MDE: 99.9%

Test #192 on Refactoring.guru by Alexander ShvetsAlexander Shvets Aug 07, 2018 Desktop Mobile Product X.X% Progression

Alexander Tested Pattern #4: Testimonials On Refactoring.guru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a number of customer reviews were added at the middle of a product page.
Total Sample: 6,504 • Statistical Power at 5% MDE: 3.8%

Test #190 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Progression

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.
Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Progression

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B
Total Sample: 96,195 • Statistical Power at 5% MDE: 48.2%

Test #188 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.
Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #187 on Trydesignlab.com by Will AndersonWill Anderson Jul 09, 2018 Desktop Mobile Product X.X% Progression

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

Pattern #71: Personalized Next Step - Variant A
Pattern #71: Personalized Next Step - Variant B

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits. 
Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%

Test #185 on Retrome.pl by Grzegorz JancewiczGrzegorz Jancewicz Jul 03, 2018 Mobile Listing X.X% Progression

Grzegorz Tested Pattern #49: Above The Fold Call To Action On Retrome.pl

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 823 • Statistical Power at 5% MDE: 4%

Test #186 by Devesh KhanalDevesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Progression

Devesh Tested Pattern #14: Exposed Menu Options

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this experiment, additional product categories were added at the top of the navigation.
Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Test #184 on Bomgar.com by Lee ElkinsLee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Progression

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Test #183 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jun 19, 2018 Desktop Mobile Product X.X% Progression

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B
Total Sample: 5,495 • Statistical Power at 5% MDE: 4.9%

Test #176 on Kenhub.com by Niels HapkeNiels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Progression

Niels Tested Pattern #4: Testimonials On Kenhub.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, testimonials were added on a checkout screen.
Total Sample: 3,333 • Statistical Power at 5% MDE: 49.3%

Test #175 on Thomasnet.com by Julian GaviriaJulian Gaviria May 14, 2018 Desktop Mobile Content X.X% Progression

Julian Tested Pattern #23: Inline Link Nudge On Thomasnet.com

Pattern #23: Inline Link Nudge - Variant A
Pattern #23: Inline Link Nudge - Variant B
Total Sample: 67,295 • Statistical Power at 5% MDE: 3%

Test #169 on Mt.com by Vito MediavillaVito Mediavilla Apr 24, 2018 Desktop Listing X.X% Progression

Vito Tested Pattern #37: List Or Grid View On Mt.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B
Total Sample: 5,934 • Statistical Power at 5% MDE: 4.5%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #168 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Apr 23, 2018 Desktop Listing X.X% Progression

Grzegorz Tested Pattern #45: Benefit Bar On Akademiafotografii.p...

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 4,302 • Statistical Power at 5% MDE: 5.5%

Test #167 on Lovehoney.co.uk by Matthew CurryMatthew Curry Apr 10, 2018 Desktop Product X.X% Progression

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Progression

Martin Tested Pattern #50: Autoplay Video On Examine.com

Pattern #50: Autoplay Video - Variant A
Pattern #50: Autoplay Video - Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #165 on Bomgar.com by Lee ElkinsLee Elkins Apr 04, 2018 Desktop Signup X.X% Progression

Lee Tested Pattern #64: Tunnel On Bomgar.com

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B
Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B
Total Sample: 7,191 • Statistical Power at 5% MDE: 11.8%

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Progression

Martin Tested Pattern #22: Empowering Headline On Examine.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%