All Latest 644 A/B Tests

MOST RECENT TESTS

Test #184 on Bomgar.com by Lee ElkinsLee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #183 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jun 19, 2018 Desktop Mobile Product X.X% Signups

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B
Total Sample: 5,495 • Statistical Power at 5% MDE: 4.9%

Test #182 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi Jun 12, 2018 Desktop Listing X.X% Engagement

Marcos Tested Pattern #6: Customer Star Ratings On Yummly.com

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B
Total Sample: 673,296 • Statistical Power at 5% MDE: 99.9%

Test #181 on Yummly.com by Kimberly CheungKimberly Cheung Jun 04, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B
Total Sample: 175,247 • Statistical Power at 5% MDE: 61.1%

Test #179 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi May 18, 2018 Desktop Listing X.X% Signups

Marcos Tested Pattern #13: Centered Forms & Buttons On Yummly.com

Pattern #13: Centered Forms & Buttons - Variant A
Pattern #13: Centered Forms & Buttons - Variant B
Total Sample: 391,537 • Statistical Power at 5% MDE: 99.5%

Test #177 by Devesh KhanalDevesh Khanal May 17, 2018 Desktop Shopping Cart X.X% Revenue

Devesh Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B

Test #178 by Devesh KhanalDevesh Khanal May 17, 2018 Desktop Product X.X% Sales

Devesh Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B
Total Sample: 63,410 • Statistical Power at 5% MDE: 9.7%

Test #176 on Kenhub.com by Niels HapkeNiels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, testimonials were added on a checkout screen.
Total Sample: 3,333 • Statistical Power at 5% MDE: 49.3%

Test #175 on Thomasnet.com by Julian GaviriaJulian Gaviria May 14, 2018 Desktop Mobile Content X.X% Leads

Julian Tested Pattern #23: Inline Link Nudge On Thomasnet.com

Pattern #23: Inline Link Nudge - Variant A
Pattern #23: Inline Link Nudge - Variant B
Total Sample: 67,295 • Statistical Power at 5% MDE: 3%

Test #174 on Examine.com by Martin WongMartin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

Pattern #67: Currency & Taxes - Variant A
Pattern #67: Currency & Taxes - Variant B
Total Sample: 1,702 • Statistical Power at 5% MDE: 8.3%

Test #172 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #173 on Rollbar.com by Mike SmithMike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 8,433 • Statistical Power at 5% MDE: 4.3%

Test #171 on Sjvc.edu by Phillip BarnesPhillip Barnes Apr 27, 2018 Desktop Mobile Signup X.X% Leads

Phillip Tested Pattern #63: Trust Seals On Sjvc.edu

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 1,197 • Statistical Power at 5% MDE: 12.8%

Test #169 on Mt.com by Vito MediavillaVito Mediavilla Apr 24, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #37: List Or Grid View On Mt.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B
Total Sample: 5,934 • Statistical Power at 5% MDE: 4.5%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #168 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Apr 23, 2018 Desktop Listing X.X% Leads

Grzegorz Tested Pattern #45: Benefit Bar On Akademiafotografii.p...

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 4,302 • Statistical Power at 5% MDE: 5.5%

Test #167 on Lovehoney.co.uk by Matthew CurryMatthew Curry Apr 10, 2018 Desktop Product X.X% Sales

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #166 on Olark.com by Sunir ShahSunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Pattern #12: Payment First - Variant A
Pattern #12: Payment First - Variant B

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).
Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

Pattern #50: Autoplay Video - Variant A
Pattern #50: Autoplay Video - Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #165 on Bomgar.com by Lee ElkinsLee Elkins Apr 04, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B
Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B
Total Sample: 7,191 • Statistical Power at 5% MDE: 11.8%