All Latest 644 A/B Tests

MOST RECENT TESTS

Test #480 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. The lowest plan only had one benefit, whereas the highest plan had 3. Impact on transactions was measured. 

Total Sample: 104,902 • Statistical Power at 5% MDE: 93%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #463 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Mar 25, 2023 Desktop Checkout X.X% Sales

Daria Tested Pattern #115: Pricing Comparison Table On Volders.de

Pattern #115: Pricing Comparison Table - Variant A
Pattern #115: Pricing Comparison Table - Variant B

This experiment explored a pricing layout that enabled more feature comparisons. It also conveyed more clearly which features were missing between plans. The test has been inspired by this Netflix experiment. Impact on sales was measured.

Total Sample: 23,336 • Statistical Power at 5% MDE: 84.8%

Test #452 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jan 30, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #62: Urgent Next Day Delivery On Volders.de

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

In this experiment, a count down timer was added near the top of a checkout page. The timer was only shown before 1pm and clarified that the serivce (contract cancellation) will be initiated on the same day if users act before a cut off time. Impact on completed payments was measured.

Total Sample: 40,999 • Statistical Power at 5% MDE: 99%

Test #435 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Oct 17, 2022 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #9: Multiple Steps On Volders.de

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a question about a customer's reason for purchase was broken out into a separate step and moved earlier in the process. In the control, this question was asked in the final checkout step along with a plan selection (Step 4 of 4). In the variation, this question was shifted as a standalone first step (Step 1 of 5). Impact on completed purchases was measured (for a contract cancellation service in this case).

Total Sample: 139,608 • Statistical Power at 5% MDE: 98.2%

Test #414 on Volders.de by Frederik FröhleFrederik Fröhle May 31, 2022 Desktop Mobile Checkout X.X% Sales

Frederik Tested Pattern #98: Auto Suggest On Volders.de

Pattern #98: Auto Suggest - Variant A
Pattern #98: Auto Suggest - Variant B

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Total Sample: 128,199 • Statistical Power at 5% MDE: 97.4%

Test #412 on Volders.de by Frederik FröhleFrederik Fröhle May 16, 2022 Desktop Mobile Checkout X.X% Sales

Frederik Tested Pattern #15: Bulleted Reassurances On Volders.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

The Volders experimentation team assumed that adding information about how long it might take to get a cancellation confirmation near a CTA Button would result in higher cancellation requests (the paid service being offered).

The variation contained additional copy translated from German to: "Most of our users receive their cancellation confirmation from <vendor> within 14 days by email or letter."

Total Sample: 53,120 • Statistical Power at 5% MDE: 99.3%

Test #403 by Jakub LinowskiJakub Linowski Mar 29, 2022 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #42: Countdown Timer

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

In this experiment, an urgency related message with a dynamic countdown timer was added on the final checkout screen. Impact on sales was measured.

Total Sample: 7,466 • Statistical Power at 5% MDE: 99.9%

Test #390 on Snocks.com by Melina HessMelina Hess Dec 21, 2021 Desktop Mobile Checkout X.X% Sales

Melina Tested Pattern #106: Back Buttons On Snocks.com

Pattern #106: Back Buttons - Variant A
Pattern #106: Back Buttons - Variant B

In this experiment, the variation has a "Back To Shopping Cart" link right underneath the checkout button. Impact on sales was measured.

Total Sample: 22,852 • Statistical Power at 5% MDE: 97.5%

Test #340 by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 • Statistical Power at 5% MDE: 97.3%

Test #320 by Jakub LinowskiJakub Linowski Oct 20, 2020 Desktop Checkout X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.

Total Sample: 2,908 • Statistical Power at 5% MDE: 97.4%

Test #274 by Someone Someone Dec 16, 2019 Desktop Mobile Checkout X.X% Sales

Someone Tested Pattern #1: Remove Coupon Fields

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

In this experiment, a fully visible coupon field (A) was made less visible by turning it into a default collaped link (B). Clicking on the link caused the coupon field to appear.

Total Sample: 3,851 • Statistical Power at 5% MDE: 90.2%

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #159 on Swimsuitsforall.com by Devesh KhanalDevesh Khanal Mar 11, 2018 Desktop Checkout X.X% Sales

Devesh Tested Pattern #63: Trust Seals On Swimsuitsforall.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 66,919 • Statistical Power at 5% MDE: 99.9%

Test #51 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 20, 2016 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #63: Trust Seals On Menufy.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 14,269 • Statistical Power at 5% MDE: 99.9%