All Latest 628 A/B Tests

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #167 on Lovehoney.co.uk by Matthew CurryMatthew Curry Apr 10, 2018 Desktop Product X.X% Progression

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

 - Variant A
 - Variant B

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Progression

Martin Tested Pattern #50: Autoplay Video On Examine.com

 - Variant A
 - Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Test #157 on Bobandlush.com by Viljo VabritViljo Vabrit Mar 06, 2018 Desktop Product X.X% Progression

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

 - Variant A
 - Variant B

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.

Test #156 on Mt.com by Vito MediavillaVito Mediavilla Feb 25, 2018 Desktop Listing X.X% Progression

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

 - Variant A
 - Variant B

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Test #139 on Examine.com by Martin WongMartin Wong Jan 04, 2018 Desktop Pricing X.X% Progression

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

 - Variant A
 - Variant B

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Progression

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

 - Variant A
 - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Progression

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

 - Variant A
 - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.