All Latest 644 A/B Tests

MOST RECENT TESTS

Test #163 on Lovehoney.co.uk by Matthew CurryMatthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Revenue

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #162 on Bullymax.com by Viljo VabritViljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

Pattern #68: Welcome Discount - Variant A
Pattern #68: Welcome Discount - Variant B
Total Sample: 14,865 • Statistical Power at 5% MDE: 8.4%

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B
Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%

Test #160 on Examine.com by Martin WongMartin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #158 on Kenhub.com by Niels HapkeNiels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #159 on Swimsuitsforall.com by Devesh KhanalDevesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #157 on Bobandlush.com by Viljo VabritViljo Vabrit Mar 06, 2018 Desktop Product X.X% Sales

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Total Sample: 1,877 • Statistical Power at 5% MDE: 6.9%

Test #156 on Mt.com by Vito MediavillaVito Mediavilla Feb 25, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).
Total Sample: 27,048 • Statistical Power at 5% MDE: 12.8%

Test #154 on Reverb.com by Nicholas EvansNicholas Evans Feb 20, 2018 Desktop Mobile Product X.X% Signups

Nicholas Tested Pattern #59: Inverted Or Consistent Button Styles On Reverb.com

Pattern #59: Inverted Or Consistent Button Styles - Variant A
Pattern #59: Inverted Or Consistent Button Styles - Variant B
Total Sample: 725,114 • Statistical Power at 5% MDE: 19.4%

Test #153 on Goodui.org by Jakub LinowskiJakub Linowski Feb 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #58: Full Height False Bottom On Goodui.org

Pattern #58: Full Height False Bottom - Variant A
Pattern #58: Full Height False Bottom - Variant B
Total Sample: 11,330 • Statistical Power at 5% MDE: 8.6%

Test #152 on Reverb.com by Nicholas EvansNicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #151 on Mamaearth.ca by Michael BernsteinMichael Bernstein Feb 08, 2018 Desktop Checkout X.X% Sales

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 1,614 • Statistical Power at 5% MDE: 7.4%

Test #150 on Normanrecords.com by Nathon RaineNathon Raine Feb 07, 2018 Desktop Home & Landing X.X% Sales

Nathon Tested Pattern #45: Benefit Bar On Normanrecords.com

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 120,700 • Statistical Power at 5% MDE: 35.2%

Test #149 on Reverb.com by Nicholas EvansNicholas Evans Feb 07, 2018 Desktop Product X.X% Signups

Nicholas Tested Pattern #16: Welcome Mat - Partial On Reverb.com

Pattern #16: Welcome Mat - Partial - Variant A
Pattern #16: Welcome Mat - Partial - Variant B
Total Sample: 726,088 • Statistical Power at 5% MDE: 17.2%

Test #148 on Kenhub.com by Niels HapkeNiels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

Pattern #53: Problem-Solution Headline - Variant A
Pattern #53: Problem-Solution Headline - Variant B
Total Sample: 49,448 • Statistical Power at 5% MDE: 74.3%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #145 on Normanrecords.com by Nathon RaineNathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.
Total Sample: 4,139 • Statistical Power at 5% MDE: 73.7%

Test #143 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Jan 14, 2018 Desktop Listing X.X% Leads

Rodrigo Tested Pattern #56: Hover Button On Vivareal.com.br

Pattern #56: Hover Button - Variant A
Pattern #56: Hover Button - Variant B
Total Sample: 2,594,182 • Statistical Power at 5% MDE: 99.9%

Test #144 on Examine.com by Martin WongMartin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #27: More For Less Headline On Examine.com

Pattern #27: More For Less Headline - Variant A
Pattern #27: More For Less Headline - Variant B
Total Sample: 15,542 • Statistical Power at 5% MDE: 7.8%