All Latest 650 A/B Tests

Test #678 by Oshri MaidanikOshri Maidanik Oct 30, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B

In this checkout experiment, an upgrade offer was added directly above the contact and delivery form. Below the express checkout buttons, the variant showed the item already in the cart (a single bottle priced at $28) and invited shoppers to upgrade to a 3-month supply for only $8 more. The bundle was shown at $36 next to a crossed-out $60, with arrows to browse other upgrade options and a prominent “Upgrade” button. As a result, the standard checkout form was pushed further down the page, behind a second “OR” divider. Imact on completed orders was measured.

Total Sample: 8,344 • Statistical Power at 5% MDE: 77.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #677 by Jakub LinowskiJakub Linowski Oct 29, 2026 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #62: Urgent Next Day Delivery

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

In this retest experiment, delivery copy was added under each product tile, letting shoppers know they could send an email gift message today. The idea was to reassure last-minute gift buyers that the recipient would hear about their gift right away, even before the physical delivery arrives. Impact on checkout visits and sales was measured.

This was a retest with an additional checkmark style for additional contrast and visibility. 

Total Sample: 44,599 • Statistical Power at 5% MDE: 39.1%

Test #674 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Oct 25, 2026 Desktop Listing X.X% Sales

Andrey Tested Pattern #107: Contrast Links & Buttons On Online.metro-cc.ru

Pattern #107: Contrast Links & Buttons - Variant A
Pattern #107: Contrast Links & Buttons - Variant B

In this experiment, the favorite icons (hearts) were: 1) highlighted more prominently using a darker border color, and 2) when users hovered over them with a mouse, the heart icon filled with a red color. Impact on favorite clicks, adds to cart and sales was measured.

Total Sample: 3,864,340 • Statistical Power at 5% MDE: 99.7%

Test #673 by Jakub LinowskiJakub Linowski Oct 13, 2026 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #62: Urgent Next Day Delivery

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

In this experiment, delivery copy was added under each product tile, letting shoppers know they could send an email gift message today. The idea was to reassure last-minute gift buyers that the recipient would hear about their gift right away, even before the physical delivery arrives. Impact on checkout visits and sales was measured.

Total Sample: 34,566 • Statistical Power at 5% MDE: 57.1%

Test #672 by Oshri MaidanikOshri Maidanik Sep 30, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #42: Countdown Timer

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment compared the checkout experience with and without a limited-time countdown timer. Impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

Total Sample: 27,125 • Statistical Power at 5% MDE: 99.9%

Test #671 on Obsbygg.no by Joachim FurusethJoachim Furuseth Sep 28, 2026 Desktop Product X.X% Sales

Joachim Tested Pattern #93: Auto Next On Obsbygg.no

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

This was a sibling experiment on another domain.

Total Sample: 251,205 • Statistical Power at 5% MDE: 69.1%

Test #668 by Oshri MaidanikOshri Maidanik Sep 13, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #42: Countdown Timer

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment compared the checkout experience with and without a limited-time countdown timer. Impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

Total Sample: 8,344 • Statistical Power at 5% MDE: 76.7%

Test #667 on Obsbygg.no by Joachim FurusethJoachim Furuseth Aug 15, 2026 Mobile Product X.X% Sales

Joachim Tested Pattern #93: Auto Next On Obsbygg.no

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

This was a sibling experiment on another domain.

Total Sample: 921,493 • Statistical Power at 5% MDE: 96%

Test #666 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2026 Desktop Listing X.X% Sales

Andrey Tested Pattern #34: Open In A New Tab On Online.metro-cc.ru

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

This experiment ran on search results page of an ecommerce grocery store.

50% of users saw product cards that upon clicking would open in the same window (Control).

The other 50% saw product cards that upon clicking would open in a new tab/window (Treatment).

Impact on adds to cart and orders was measured.

We should also add that this experiment was run as part of the Trustworthy Replication Project and only "adds-to-cart" were pre-registered as the primary metric - https://osf.io/yu4gm/overview

Total Sample: 655,042 • Statistical Power at 5% MDE: 99.9%

Test #664 by Oshri MaidanikOshri Maidanik Aug 12, 2026 Desktop Mobile Checkout X.X% Sales

Oshri Tested Pattern #4: Testimonials

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment showed a single testimonial and impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

Total Sample: 37,103 • Statistical Power at 5% MDE: 99.9%

Test #663 by Jakub LinowskiJakub Linowski Jul 29, 2026 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #20: Canned Response

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B

In this experiment, users were able to auto-generate gift messages during the checkout flow based on input fields above. For this reason, the message input area was also shifted further down beyond the initial fields.

Total Sample: 3,838 • Statistical Power at 5% MDE: 84.4%

Test #662 by Jakub LinowskiJakub Linowski Jul 16, 2026 Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #15: Bulleted Reassurances

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this checkout funnel experiment, instead of showing order details and reassurances in a labeled key-value format (e.g., "Club Length: 6 Months"), they were condensed into an unlabeled bullet list. Media logo badges were also removed. Impact on checkouts and sales was measured.

Total Sample: 2,375 • Statistical Power at 5% MDE: 27.8%

Test #661 by Jakub LinowskiJakub Linowski Jul 08, 2026 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #98: Auto Suggest

Pattern #98: Auto Suggest - Variant A
Pattern #98: Auto Suggest - Variant B

In this experiment, instead of utilizing the browser auto-complete for the street address, the Google API call was made using the postal/zip code as the input. Once users would begin typing a street address, a pull-down with matching recommendations would appear. Impact on next step visits (to checkout) and sales were measured.

Total Sample: 9,611 • Statistical Power at 5% MDE: 77%

Test #660 on Obs.no by Joachim FurusethJoachim Furuseth Jul 07, 2026 Desktop Product X.X% Sales

Joachim Tested Pattern #93: Auto Next On Obs.no

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

Total Sample: 93,949 • Statistical Power at 5% MDE: 40.9%

Test #659 on Obs.no by Joachim FurusethJoachim Furuseth Jul 06, 2026 Mobile Product X.X% Sales

Joachim Tested Pattern #93: Auto Next On Obs.no

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

Total Sample: 554,138 • Statistical Power at 5% MDE: 96.8%

Test #658 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 30, 2026 Desktop Listing X.X% Sales

Andrey Tested Pattern #92: Already Viewed Label On Online.metro-cc.ru

Pattern #92: Already Viewed Label - Variant A
Pattern #92: Already Viewed Label - Variant B

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

Total Sample: 980,372 • Statistical Power at 5% MDE: 80.5%

Test #657 on Obsbygg.no by Joachim FurusethJoachim Furuseth Jun 28, 2026 Desktop Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment (sibling of 656), a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

Total Sample: 1,238,014 • Statistical Power at 5% MDE: 98.8%

Test #656 on Obs.no by Joachim FurusethJoachim Furuseth Jun 27, 2026 Desktop Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

Total Sample: 675,173 • Statistical Power at 5% MDE: 98.4%

Test #655 by Jakub LinowskiJakub Linowski Jun 22, 2026 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #113: More Or Fewer Plans

Pattern #113: More Or Fewer Plans - Variant A
Pattern #113: More Or Fewer Plans - Variant B

In this experiment, an additional ongoing club was tested in a floating buy box on top of 4 other subscription durations. Impact on adds to cart and sales was measured.

Total Sample: 9,548 • Statistical Power at 5% MDE: 9.1%

Test #654 by Jakub LinowskiJakub Linowski Jun 18, 2026 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #11: Gradual Reassurance

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, product configuration options were moved from a floating buy box on the right, to wards the center of the product page - increasing their prominence. Impact on adds to cart and sales was measured.

Total Sample: 8,379 • Statistical Power at 5% MDE: 15%