All Latest 634 A/B Tests

Test #186 on by Devesh KhanalDevesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

- Variant A
- Variant B

In this experiment, additional product categories were added at the top of the navigation.
Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #183 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jun 19, 2018 Desktop Mobile Product X.X% Signups

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

- Variant A
- Variant B
Total Sample: 5,495 • Statistical Power at 5% MDE: 4.9%

Test #182 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi Jun 12, 2018 Desktop Listing X.X% Engagement

Marcos Tested Pattern #6: Customer Star Ratings On Yummly.com

- Variant A
- Variant B
Total Sample: 673,296 • Statistical Power at 5% MDE: 99.9%

Test #181 on Yummly.com by Kimberly CheungKimberly Cheung Jun 04, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

- Variant A
- Variant B
Total Sample: 175,247 • Statistical Power at 5% MDE: 61.1%

Test #180 on Radhabeauty.com by Viljo VabritViljo Vabrit Jun 03, 2018 Mobile Global X.X% Sales

Viljo Tested Pattern #45: Benefit Bar On Radhabeauty.com

- Variant A
- Variant B
Total Sample: 17,926 • Statistical Power at 5% MDE: 12.2%

Test #177 on by Devesh KhanalDevesh Khanal May 17, 2018 Desktop Shopping Cart X.X% Revenue

Devesh Tested Pattern #66: Complementary Upsell

- Variant A
- Variant B

Test #178 on by Devesh KhanalDevesh Khanal May 17, 2018 Desktop Product X.X% Sales

Devesh Tested Pattern #66: Complementary Upsell

- Variant A
- Variant B
Total Sample: 63,410 • Statistical Power at 5% MDE: 9.7%

Test #176 on Kenhub.com by Niels HapkeNiels Hapke May 16, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #4: Testimonials On Kenhub.com

- Variant A
- Variant B

In this experiment, testimonials were added on a checkout screen.
Total Sample: 3,333 • Statistical Power at 5% MDE: 49.3%

Test #175 on Thomasnet.com by Julian GaviriaJulian Gaviria May 14, 2018 Desktop Mobile Content X.X% Leads

Julian Tested Pattern #23: Inline Link Nudge On Thomasnet.com

- Variant A
- Variant B
Total Sample: 67,295 • Statistical Power at 5% MDE: 3%

Test #171 on Sjvc.edu by Phillip BarnesPhillip Barnes Apr 27, 2018 Desktop Mobile Signup X.X% Leads

Phillip Tested Pattern #63: Trust Seals On Sjvc.edu

- Variant A
- Variant B
Total Sample: 1,197 • Statistical Power at 5% MDE: 12.8%

Test #168 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Apr 23, 2018 Desktop Listing X.X% Leads

Grzegorz Tested Pattern #45: Benefit Bar On Akademiafotografii.p...

- Variant A
- Variant B
Total Sample: 4,302 • Statistical Power at 5% MDE: 5.5%

Test #167 on Lovehoney.co.uk by Matthew CurryMatthew Curry Apr 10, 2018 Desktop Product X.X% Sales

Matthew Tested Pattern #69: Autodiscounting On Lovehoney.co.uk

- Variant A
- Variant B

The idea is that, if the customer has an active discount code for that session (either by landing on a particular page, or entering a code somewhere), instead of just showing the discount in the basket, we show it further (earlier) up the funnel and automatically discount on the product page.

The effectiveness of this depends on the discount level, I've tested it at 30% and 50%.

With a 50% Discount:
Add to Cart rate +33%
Sales rate + 24%

With a 30% Discount:
Add to Cart rate +11.6%
Sales rate + 10.2%

Test #162 on Bullymax.com by Viljo VabritViljo Vabrit Mar 20, 2018 Desktop Home & Landing X.X% Sales

Viljo Tested Pattern #68: Welcome Discount On Bullymax.com

- Variant A
- Variant B
Total Sample: 14,865 • Statistical Power at 5% MDE: 8.4%

Test #160 on Examine.com by Martin WongMartin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

- Variant A
- Variant B
Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #158 on Kenhub.com by Niels HapkeNiels Hapke Mar 11, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #63: Trust Seals On Kenhub.com

- Variant A
- Variant B
Total Sample: 3,516 • Statistical Power at 5% MDE: 61.6%

Test #159 on Swimsuitsforall.com by Devesh KhanalDevesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

- Variant A
- Variant B
Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #157 on Bobandlush.com by Viljo VabritViljo Vabrit Mar 06, 2018 Desktop Product X.X% Sales

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

- Variant A
- Variant B

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Total Sample: 1,877 • Statistical Power at 5% MDE: 6.9%

Test #156 on Mt.com by Vito MediavillaVito Mediavilla Feb 25, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

- Variant A
- Variant B

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).
Total Sample: 27,048 • Statistical Power at 5% MDE: 12.8%

Test #152 on Reverb.com by Nicholas EvansNicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

- Variant A
- Variant B
Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #151 on Mamaearth.ca by Michael BernsteinMichael Bernstein Feb 08, 2018 Desktop Checkout X.X% Sales

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

- Variant A
- Variant B
Total Sample: 1,614 • Statistical Power at 5% MDE: 7.4%