All Latest 644 A/B Tests

MOST RECENT TESTS

Test #672 by Oshri MaidanikOshri Maidanik Sep 30, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #42: Countdown Timer

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment compared the checkout experience with and without a limited-time countdown timer. Impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

Total Sample: 27,125 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #664 by Oshri MaidanikOshri Maidanik Aug 12, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #4: Testimonials

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment showed a single testimonial and impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

Total Sample: 37,103 • Statistical Power at 5% MDE: 99.9%

Test #663 by Jakub LinowskiJakub Linowski Jul 29, 2026 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #20: Canned Response

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B

In this experiment, users were able to auto-generate gift messages during the checkout flow based on input fields above. For this reason, the message input area was also shifted further down beyond the initial fields.

Total Sample: 3,838 • Statistical Power at 5% MDE: 84.4%

Test #640 on Obs.no by Joachim FurusethJoachim Furuseth Mar 24, 2026 Desktop Checkout X.X% Sales

Joachim Tested Pattern #1: Remove Coupon Fields On Obs.no

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)

Total Sample: 41,152 • Statistical Power at 5% MDE: 99.9%

Test #639 on Obs.no by Joachim FurusethJoachim Furuseth Mar 23, 2026 Mobile Checkout X.X% Sales

Joachim Tested Pattern #1: Remove Coupon Fields On Obs.no

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

Total Sample: 187,529 • Statistical Power at 5% MDE: 99.9%

Test #634 on Obsbygg.no by Joachim FurusethJoachim Furuseth Feb 18, 2026 Mobile Checkout X.X% Sales

Joachim Tested Pattern #1: Remove Coupon Fields On Obsbygg.no

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

Total Sample: 66,551 • Statistical Power at 5% MDE: 99.9%

Test #635 on Obsbygg.no by Joachim FurusethJoachim Furuseth Feb 18, 2026 Desktop Checkout X.X% Sales

Joachim Tested Pattern #1: Remove Coupon Fields On Obsbygg.no

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)

Total Sample: 27,380 • Statistical Power at 5% MDE: 96.5%

Test #632 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 30, 2026 Desktop Mobile Checkout X.X% Sales

Andrey Tested Pattern #65: Add More For Extra Incentive On Online.metro-cc.ru

Pattern #65: Add More For Extra Incentive - Variant A
Pattern #65: Add More For Extra Incentive - Variant B

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.

Total Sample: 36,284 • Statistical Power at 5% MDE: 86.7%

Test #624 by Frazer MawsonFrazer Mawson Dec 22, 2025 Mobile Checkout X.X% Sales

Frazer Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating "Confirm Payment" button was added on the last step of a checkout flow. The button appeared with two different states: in a disabled state, leading to the terms and conditions; and in an active state, after checking off the terms. Impact on purchases was measured. 

Total Sample: 114,921 • Statistical Power at 5% MDE: 95.8%

Test #622 by Frazer MawsonFrazer Mawson Nov 27, 2025 Mobile Checkout X.X% Sales

Frazer Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a breadcrumb was replaced with a circular progress bar (arguably more visible overall steps; but less visible/clickable accomplished steps). Impact on transactions was measured.

Total Sample: 37,683 • Statistical Power at 5% MDE: 99.1%

Test #615 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Oct 28, 2025 Mobile Checkout X.X% Sales

Andrey Tested Pattern #64: Tunnel On Online.metro-cc.ru

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, two sets of distractions were removed from the checkout put. First, the search bar was removed from the top of the screen. Second, a series of app links were also removed from the bottom of the screen near the footer. Impact on checkouts was measured.

Total Sample: 206,500 • Statistical Power at 5% MDE: 99.9%

Test #612 by Frazer MawsonFrazer Mawson Sep 28, 2025 Mobile Checkout X.X% Sales

Frazer Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a 3 step progress bar was added at the top of an ecommerce checkout funnel. Impact on checkout progression and completed sales was measured.

Total Sample: 43,113 • Statistical Power at 5% MDE: 99.2%

Test #600 by Jakub LinowskiJakub Linowski Jul 18, 2025 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #63: Trust Seals

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B

In this experiment, 4 accepted credit card icons were added to an add-to-cart and checkout flow. Impact on sales was measured.

Total Sample: 7,986 • Statistical Power at 5% MDE: 82.6%

Test #538 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jun 20, 2024 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #77: Filled Or Ghost Buttons On Volders.de

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

Total Sample: 56,025 • Statistical Power at 5% MDE: 99.8%

Test #531 on Aboalarm.de by Katharina LayKatharina Lay May 03, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #128: Standard Or Superscript Price Format On Aboalarm.de

Pattern #128: Standard Or Superscript Price Format - Variant A
Pattern #128: Standard Or Superscript Price Format - Variant B

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

Total Sample: 175,677 • Statistical Power at 5% MDE: 99.3%

Test #519 on Volders.de by Katharina LayKatharina Lay Feb 23, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #134: Optional or Confident Recommendation On Volders.de

Pattern #134: Optional or Confident Recommendation - Variant A
Pattern #134: Optional or Confident Recommendation - Variant B

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

Total Sample: 58,597 • Statistical Power at 5% MDE: 99.9%

Test #518 by Jakub LinowskiJakub Linowski Feb 14, 2024 Mobile Checkout X.X% Sales

Jakub Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

This was an experiment on the first checkout step where users would enter shipping information. The control had a longer footer with more additional sitewide links and a call to action to a newsletter. The variation removed these elements and kept the focus on the shipping information task. Impact on progression to next step and sales was measured.

Total Sample: 10,900 • Statistical Power at 5% MDE: 85.8%

Test #517 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Feb 12, 2024 Desktop Checkout X.X% Sales

Daria Tested Pattern #78: Tags, Badges And Structured Information On Aboalarm.de

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

Total Sample: 127,712 • Statistical Power at 5% MDE: 94.9%

Test #483 on Menufy.com by Aleksandr ElesevAleksandr Elesev Jul 17, 2023 Desktop Checkout X.X% Sales

Aleksandr Tested Pattern #124: Confirmed Selection On Menufy.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, a thanking confirmation message was appended at the top of the checkout screen of a local food delivery service. Impact on completed transactions was measured.

Total Sample: 8,626 • Statistical Power at 5% MDE: 99.9%

Test #479 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. Benefit items not included in the lower plans were also shown with grayed out styles (and an "x"). Clearly the higher paid plan had all the benefits listed. Impact on transactions was measured. 

Total Sample: 104,863 • Statistical Power at 5% MDE: 93%