All Latest 620 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Test #180 on Radhabeauty.com by Viljo Vabrit Jun 03, 2018 Mobile Global X.X% Sales

Viljo Tested Pattern #45: Benefit Bar On Radhabeauty.com

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Join To See Winners And Estimate Your Tests

Test #178 on by Devesh Khanal May 17, 2018 Desktop Product X.X% Sales

Devesh Tested Pattern #66: Complementary Upsell

Test #176 on Kenhub.com by Niels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

In this experiment, testimonials were added on a checkout screen.

Test #174 on Examine.com by Martin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

Test #170 on Goodui.org by Jakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Test #167 on Lovehoney.co.uk by Matthew Curry Apr 10, 2018 Desktop Product X.X% Sales

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #166 on Olark.com by Sunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Test #164 on Examine.com by Martin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Test #163 on Lovehoney.co.uk by Matthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Sales

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

Test #162 on Bullymax.com by Viljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

Test #160 on Examine.com by Martin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Test #159 on Swimsuitsforall.com by Devesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Test #158 on Kenhub.com by Niels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Test #157 on Bobandlush.com by Viljo Vabrit Mar 06, 2018 Desktop Product X.X% Sales

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.

Test #152 on Reverb.com by Nicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Test #151 on Mamaearth.ca by Michael Bernstein Feb 08, 2018 Desktop Checkout X.X% Sales

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

Test #150 on Normanrecords.com by Nathon Raine Feb 07, 2018 Desktop Home & Landing X.X% Sales

Nathon Tested Pattern #45: Benefit Bar On Normanrecords.com

Test #147 on Reverb.com by Nicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Test #145 on Normanrecords.com by Nathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.

Test #144 on Examine.com by Martin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales