All Latest 644 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #403 by Jakub Linowski Mar 29, 2022 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #42: Countdown Timer

Pattern #42: Countdown Timer - Variant A

Pattern #42: Countdown Timer - Variant B

In this experiment, an urgency related message with a dynamic countdown timer was added on the final checkout screen. Impact on sales was measured.

Total Sample: 7,466 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #399 by Jakub Linowski Feb 27, 2022 Desktop Mobile Checkout X.X% Progression

Jakub Tested Pattern #35: Floating Labels

Pattern #35: Floating Labels - Variant A

Pattern #35: Floating Labels - Variant B

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).

Total Sample: 2,073 • Statistical Power at 5% MDE: 29.2%

Test #390 on Snocks.com by Melina Hess Dec 21, 2021 Desktop Mobile Checkout X.X% Sales

Melina Tested Pattern #106: Back Buttons On Snocks.com

In this experiment, the variation has a "Back To Shopping Cart" link right underneath the checkout button. Impact on sales was measured.

Total Sample: 22,852 • Statistical Power at 5% MDE: 97.5%

Test #389 on Svsound.com by Keenan Davis Dec 16, 2021 Desktop Mobile Checkout X.X% Sales

Keenan Tested Pattern #1: Remove Coupon Fields On Svsound.com

Pattern #1: Remove Coupon Fields - Variant A

Pattern #1: Remove Coupon Fields - Variant B

In this simple experiment, a highly visible coupon field was replaced with a less visible (but clickable) link in the variation. Clicking on the link would show the coupon field. Impact on sales and revenue was measured.

Total Sample: 20,321 • Statistical Power at 5% MDE: 37.2%

Test #383 by Jakub Linowski Nov 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #123: Single Or Double Column Form Fields

Pattern #123: Single Or Double Column Form Fields - Variant A

Pattern #123: Single Or Double Column Form Fields - Variant B

In this simple [inverted] experiment, the variation organized the form fields into a single column. The control had two columns of form fields.

Total Sample: 2,143 • Statistical Power at 5% MDE: 23.3%

Test #344 by Jakub Linowski Mar 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

Pattern #108: Frequently Asked Questions - Variant A

Pattern #108: Frequently Asked Questions - Variant B

Three common delivery questions were answered at the bottom of a checkout page.

Total Sample: 18,871 • Statistical Power at 5% MDE: 50.1%

Test #340 by Jakub Linowski Feb 25, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A

Pattern #114: Less Or More Visible Prices - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 • Statistical Power at 5% MDE: 97.3%

Test #320 by Jakub Linowski Oct 20, 2020 Desktop Checkout X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action

Pattern #49: Above The Fold Call To Action - Variant A

Pattern #49: Above The Fold Call To Action - Variant B

An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.

Total Sample: 2,908 • Statistical Power at 5% MDE: 97.4%

Test #61 by Someone Jun 26, 2020 Desktop Checkout X.X% Sales

Someone Tested Pattern #9: Multiple Steps

In this experiment, a single screen checkout was turned into a series of smaller steps in variation B. This was achieved by showing fewer fields on the first step, and shifting the remaining ones into a 3 step modal popup. The experiment measured successful transactions (sales).

Total Sample: 8,886 • Statistical Power at 5% MDE: 11.1%

Test #274 by Someone Dec 16, 2019 Desktop Mobile Checkout X.X% Sales

Someone Tested Pattern #1: Remove Coupon Fields

In this experiment, a fully visible coupon field (A) was made less visible by turning it into a default collaped link (B). Clicking on the link caused the coupon field to appear.

Total Sample: 3,851 • Statistical Power at 5% MDE: 90.2%

Test #267 on Backstage.com by Stanley Zuo Nov 05, 2019 Mobile Checkout X.X% Sales

Stanley Tested Pattern #99: Progress Bar On Backstage.com

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.

Total Sample: 8,552 • Statistical Power at 5% MDE: 6%

Test #261 on Valkexclusief.nl by Online Dialogue Sep 20, 2019 Desktop Checkout X.X% Sales

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

Pattern #111: Field Explanations - Variant A

Pattern #111: Field Explanations - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout X.X% Sales

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

Pattern #6: Customer Star Ratings - Variant A

Pattern #6: Customer Star Ratings - Variant B

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Total Sample: 20,661 • Statistical Power at 5% MDE: 30.3%

Test #229 by Jakub Linowski Mar 08, 2019 Desktop Mobile Checkout X.X% Sales