All Latest 643 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #166 on Olark.com by Sunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #164 on Examine.com by Martin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #165 on Bomgar.com by Lee Elkins Apr 04, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

Total Sample: 7,191 • Statistical Power at 5% MDE: 11.8%

Test #163 on Lovehoney.co.uk by Matthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Revenue

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

Test #162 on Bullymax.com by Viljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

Total Sample: 14,865 • Statistical Power at 5% MDE: 8.4%

Test #161 on Examine.com by Martin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%

Test #160 on Examine.com by Martin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #159 on Swimsuitsforall.com by Devesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #158 on Kenhub.com by Niels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #157 on Bobandlush.com by Viljo Vabrit Mar 06, 2018 Desktop Product X.X% Sales

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.

Total Sample: 1,877 • Statistical Power at 5% MDE: 6.9%

Test #156 on Mt.com by Vito Mediavilla Feb 25, 2018 Desktop Listing X.X% Leads