All Latest 607 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #169 on Mt.com by Vito Mediavilla Apr 24, 2018 Desktop Listing

Vito Tested Pattern #37: List Or Grid View On Mt.com

Test #170 on Goodui.org by Jakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Test #168 on Akademiafotografii.p... by Grzegorz Jancewicz Apr 23, 2018 Desktop Listing

Grzegorz Tested Pattern #45: Benefit Bar On Akademiafotografii.p...

Test #167 on Lovehoney.co.uk by Matthew Curry Apr 10, 2018 Desktop Product

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #166 on Olark.com by Sunir Shah Apr 05, 2018 Desktop Mobile Home & Landing

Sunir Tested Pattern #12: Payment First On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Test #164 on Examine.com by Martin Wong Apr 04, 2018 Desktop Mobile Thank You

Martin Tested Pattern #50: Autoplay Video On Examine.com

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Test #165 on Bomgar.com by Lee Elkins Apr 04, 2018 Desktop Signup

Lee Tested Pattern #64: Tunnel On Bomgar.com

Test #163 on Lovehoney.co.uk by Matthew Curry Mar 27, 2018 Mobile Desktop Product

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

Test #162 on Bullymax.com by Viljo Vabrit Mar 20, 2018 Desktop Home & Landing

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

Test #161 on Examine.com by Martin Wong Mar 19, 2018 Desktop Mobile Home & Landing

Martin Tested Pattern #22: Empowering Headline On Examine.com

Test #160 on Examine.com by Martin Wong Mar 15, 2018 Desktop Mobile Product

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Test #158 on Kenhub.com by Niels Hapke Mar 11, 2018 Desktop Mobile Checkout

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Test #159 on Swimsuitsforall.com by Devesh Khanal Mar 11, 2018 Desktop Checkout

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Test #157 on Bobandlush.com by Viljo Vabrit Mar 06, 2018 Desktop Product

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.

Test #156 on Mt.com by Vito Mediavilla Feb 25, 2018 Desktop Listing