All Latest 644 A/B Tests

Test #139 on Examine.com by Martin WongMartin Wong Jan 04, 2018 Desktop Pricing X.X% Sales

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.
Total Sample: 18,620 • Statistical Power at 5% MDE: 7.6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,258 • Statistical Power at 5% MDE: 8.2%

Test #136 on Missetam.nl by Marlies Wilms FloetMarlies Wilms Floet Dec 18, 2017 Desktop Product X.X% Sales

Marlies Wilms Tested Pattern #42: Countdown Timer On Missetam.nl

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Test #134 on Kenhub.com by Niels HapkeNiels Hapke Dec 14, 2017 Desktop Product X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.
Total Sample: 29,743 • Statistical Power at 5% MDE: 13.5%

Test #130 on Kenhub.com by Niels HapkeNiels Hapke Dec 07, 2017 Desktop Pricing X.X% Sales

Niels Tested Pattern #17: Least Or Most Expensive First On Kenhub.com

Pattern #17: Least Or Most Expensive First - Variant A
Pattern #17: Least Or Most Expensive First - Variant B

In this experiment, the plans were sorted by the most expensive first, left to right (variation).

Test #117 on Ssdnodes.com by Matt ConnorMatt Connor Oct 02, 2017 Desktop Shopping Cart X.X% Sales

Matt Tested Pattern #21: What It's Worth On Ssdnodes.com

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B
Total Sample: 4,000 • Statistical Power at 5% MDE: 7.9%

Test #93 on Examine.com by Martin WongMartin Wong Aug 01, 2017 Desktop Home & Landing X.X% Sales

Martin Tested Pattern #29: Surfaced Content On Examine.com

Pattern #29: Surfaced Content - Variant A
Pattern #29: Surfaced Content - Variant B
Total Sample: 102,416 • Statistical Power at 5% MDE: 6.1%

Test #89 on Ssdnodes.com by Matt ConnorMatt Connor Jun 01, 2017 Desktop Mobile Checkout X.X% Sales

Matt Tested Pattern #4: Testimonials On Ssdnodes.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 2,325 • Statistical Power at 5% MDE: 7.3%

Test #106 on Examine.com by Martin WongMartin Wong May 23, 2017 Desktop Product X.X% Sales

Martin Tested Pattern #15: Bulleted Reassurances On Examine.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

Three reassurances were added underneath each purchase button: Lifetime Updates, Works On All Devices and Money-Back Guarantee.
Total Sample: 10,576 • Statistical Power at 5% MDE: 6.5%

Test #107 on Examine.com by Martin WongMartin Wong May 22, 2017 Desktop Product X.X% Sales

Martin Tested Pattern #14: Exposed Menu Options On Examine.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B
Total Sample: 10,662 • Statistical Power at 5% MDE: 6.8%

Test #84 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Mar 02, 2017 Desktop Mobile Home & Landing X.X% Sales

Jaymie Tested Pattern #7: Social Counts On Onlinefaxes.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B
Total Sample: 25,610 • Statistical Power at 5% MDE: 36.2%

Test #83 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Mar 02, 2017 Desktop Home & Landing X.X% Sales

Jaymie Tested Pattern #4: Testimonials On Onlinefaxes.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 25,482 • Statistical Power at 5% MDE: 36%

Test #79 by Chris GowardChris Goward Jan 10, 2017 Desktop Product X.X% Sales

Chris Tested Pattern #15: Bulleted Reassurances

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 11,006 • Statistical Power at 5% MDE: 21%

Test #66 on Telestream.net by Chris GowardChris Goward Nov 01, 2016 Shopping Cart X.X% Sales

Chris Tested Pattern #9: Multiple Steps On Telestream.net

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

Telestream specializes in software that make it possible to get video content to any audience regardless of how it is created, distributed, or viewed. Telestream’s customer acquisition strategy is centered around driving traffic to their website to trial, or to purchase from their online store. Shoppers can buy software online, download it right away, and immediately start using it. The variation was designed with the same information as the control except spread across 4 steps (instead of 3). The rationale was that each step would be shorter and less overwhelming for the user.
Total Sample: 7,610 • Statistical Power at 5% MDE: 33.7%

Test #70 on Uptowork.com by Kuba KoziejKuba Koziej Nov 01, 2016 Desktop Pricing X.X% Sales

Kuba Tested Pattern #17: Least Or Most Expensive First On Uptowork.com

Pattern #17: Least Or Most Expensive First - Variant A
Pattern #17: Least Or Most Expensive First - Variant B

This test simply ordered the pricing plans from highest to most expensive. Overall sales decreased by an insignificant -1% with a possible +14% increase to the most expensive plan. The net effect was an insignificant 0.9% increase the the premium plans.

Test #51 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 20, 2016 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #63: Trust Seals On Menufy.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 14,269 • Statistical Power at 5% MDE: 99.9%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 19,399 • Statistical Power at 5% MDE: 48.7%

Test #57 by Jakub LinowskiJakub Linowski Jul 07, 2016 Desktop Checkout X.X% Sales

Jakub Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B
Total Sample: 6,079 • Statistical Power at 5% MDE: 12.5%

Test #47 on Adoramapix.com by Herman KleinHerman Klein Jun 09, 2016 Desktop Shopping Cart X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 3,083 • Statistical Power at 5% MDE: 59.9%