All Latest 634 A/B Tests

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

- Variant A
- Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #163 on Lovehoney.co.uk by Matthew CurryMatthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Sales

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

- Variant A
- Variant B

Test #162 on Bullymax.com by Viljo VabritViljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

- Variant A
- Variant B
Total Sample: 14,865 • Statistical Power at 5% MDE: 8.4%

Test #160 on Examine.com by Martin WongMartin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

- Variant A
- Variant B
Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #158 on Kenhub.com by Niels HapkeNiels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

- Variant A
- Variant B
Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #159 on Swimsuitsforall.com by Devesh KhanalDevesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

- Variant A
- Variant B
Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #157 on Bobandlush.com by Viljo VabritViljo Vabrit Mar 06, 2018 Desktop Product X.X% Sales

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

- Variant A
- Variant B

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Total Sample: 1,877 • Statistical Power at 5% MDE: 6.9%

Test #152 on Reverb.com by Nicholas EvansNicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

- Variant A
- Variant B
Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #151 on Mamaearth.ca by Michael BernsteinMichael Bernstein Feb 08, 2018 Desktop Checkout X.X% Sales

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

- Variant A
- Variant B
Total Sample: 1,614 • Statistical Power at 5% MDE: 7.4%

Test #150 on Normanrecords.com by Nathon RaineNathon Raine Feb 07, 2018 Desktop Home & Landing X.X% Sales

Nathon Tested Pattern #45: Benefit Bar On Normanrecords.com

- Variant A
- Variant B
Total Sample: 120,700 • Statistical Power at 5% MDE: 35.2%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

- Variant A
- Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #145 on Normanrecords.com by Nathon RaineNathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

- Variant A
- Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.
Total Sample: 4,139 • Statistical Power at 5% MDE: 73.7%

Test #144 on Examine.com by Martin WongMartin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #27: More For Less Headline On Examine.com

- Variant A
- Variant B
Total Sample: 15,542 • Statistical Power at 5% MDE: 7.8%

Test #139 on Examine.com by Martin WongMartin Wong Jan 04, 2018 Desktop Pricing X.X% Sales

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

- Variant A
- Variant B

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.
Total Sample: 18,620 • Statistical Power at 5% MDE: 7.6%

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

- Variant A
- Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

- Variant A
- Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,258 • Statistical Power at 5% MDE: 8.2%

Test #136 on Missetam.nl by Marlies Wilms FloetMarlies Wilms Floet Dec 18, 2017 Desktop Product X.X% Sales

Marlies Wilms Tested Pattern #42: Countdown Timer On Missetam.nl

- Variant A
- Variant B

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Test #134 on Kenhub.com by Niels HapkeNiels Hapke Dec 14, 2017 Desktop Product X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

- Variant A
- Variant B

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.
Total Sample: 29,743 • Statistical Power at 5% MDE: 13.5%

Test #130 on Kenhub.com by Niels HapkeNiels Hapke Dec 07, 2017 Desktop Pricing X.X% Sales

Niels Tested Pattern #17: Least Or Most Expensive First On Kenhub.com

- Variant A
- Variant B

In this experiment, the plans were sorted by the most expensive first, left to right (variation).

Test #117 on Ssdnodes.com by Matt ConnorMatt Connor Oct 02, 2017 Desktop Shopping Cart X.X% Sales

Matt Tested Pattern #21: What It's Worth On Ssdnodes.com

- Variant A
- Variant B
Total Sample: 4,000 • Statistical Power at 5% MDE: 7.9%