All Latest 644 A/B Tests

MOST RECENT TESTS

Test #662 by Jakub LinowskiJakub Linowski Jul 16, 2026 Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #15: Bulleted Reassurances

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this checkout funnel experiment, instead of showing order details and reassurances in a labeled key-value format (e.g., "Club Length: 6 Months"), they were condensed into an unlabeled bullet list. Media logo badges were also removed. Impact on checkouts and sales was measured.

Total Sample: 2,375 • Statistical Power at 5% MDE: 27.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #642 by Frazer MawsonFrazer Mawson Mar 27, 2026 Mobile Shopping Cart X.X% Sales

Frazer Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

The A version showed a non-sticky checkout button at the bottom of a flyout cart. The B variation added a sticky bar with a price summary and checkout button, keeping it always visible. Impact on sales was measured.

Total Sample: 310,981 • Statistical Power at 5% MDE: 68.8%

Test #631 by Frazer MawsonFrazer Mawson Jan 29, 2026 Mobile Shopping Cart X.X% Sales

Frazer Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, the shopping cart screen displayed a floating “Checkout” button with common credit card icons that directed users to the checkout page when clicked. In the control, the button was positioned inline, further down the page. Impact on progression to checkout and total sales were measured.

Total Sample: 80,003 • Statistical Power at 5% MDE: 99.9%

Test #573 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 28, 2025 Mobile Shopping Cart X.X% Sales

Andrey Tested Pattern #41: Sticky Call To Action On Online.metro-cc.ru

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

Total Sample: 6,527 • Statistical Power at 5% MDE: 41.6%

Test #457 by Jakub LinowskiJakub Linowski Feb 26, 2023 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, hamburger navigation with product links, was removed from the shopping / add to cart page. Tertiary links (How It Works, Guarantee details and support pages) were also removed, while a "Secure Checkout" message was brought into the header. This header version was already present on the next checkout page, and was copied over one step earlier. The idea was to keep customers within the checkout flow. Impact on sales was measured.

Total Sample: 4,452 • Statistical Power at 5% MDE: 48.6%

Test #453 by Jakub LinowskiJakub Linowski Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, the footer was simplified with multiple elements being removed (catalog request, secondary links, and a guarantee). Additionally, a more prominent phone number was also displayed.

Total Sample: 17,107 • Statistical Power at 5% MDE: 91.8%

Test #454 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this shopping cart experiment, a tall footer was completely removed. The footer contained elements such as: app download links, a newsletter signup, secondary web site links, trust symbols, social media icons and company contant information. Impact on sales was measured.

Total Sample: 18,201 • Statistical Power at 5% MDE: 51.9%

Test #450 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 20, 2023 Desktop Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, top category navigation (with fly out categories) was removed from the shopping cart of an online store. Impact on sale transactions was measured.

Total Sample: 4,737 • Statistical Power at 5% MDE: 25.4%

Test #424 by Sandis ViksnaSandis Viksna Jul 28, 2022 Desktop Shopping Cart X.X% Sales

Sandis Tested Pattern #45: Benefit Bar

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 3 reassurances were shown at the bottom of cart and checkout pages. The web site was selling health and nutrition products for males and one of the reassurances included "discreet shipping". Impact on sales was measured.

Total Sample: 8,655 • Statistical Power at 5% MDE: 8.6%

Test #422 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jul 22, 2022 Desktop Mobile Shopping Cart X.X% Sales

Daria Tested Pattern #3: Fewer Form Fields On Volders.de

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

A birthdate field was removed during a signup process for a paid contract cancellation service. Impact on progression (next step) and sales (completed transactions) was measured.

Total Sample: 20,345 • Statistical Power at 5% MDE: 16.6%

Test #413 by Jakub LinowskiJakub Linowski May 26, 2022 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Total Sample: 5,698 • Statistical Power at 5% MDE: 59.9%

Test #400 by Herman KleinHerman Klein Mar 06, 2022 Desktop Shopping Cart X.X% Sales

Herman Tested Pattern #65: Add More For Extra Incentive

Pattern #65: Add More For Extra Incentive - Variant A
Pattern #65: Add More For Extra Incentive - Variant B

In this experiment, customers who were not yet eligible for free shipping (with cart amounts under $39) were presented with an encouraging message to add more and earn free shipping. Impact on progression to checkout and sales was measured.

Total Sample: 3,111 • Statistical Power at 5% MDE: 60.3%

Test #398 on Adoramapix.com by Herman KleinHerman Klein Feb 25, 2022 Desktop Shopping Cart X.X% Sales

Herman Tested Pattern #121: Free Shipping On Adoramapix.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this experiment, customers were eligible for free shipping (with cart amounts of $39 or more) were presented with an earned free shipping message. The variation also showed the value of the earned free shipping - (for example $10). Impact on progression to checkout and sales was measured.

Total Sample: 3,123 • Statistical Power at 5% MDE: 60.5%

Test #393 on Snocks.com by Melina HessMelina Hess Jan 19, 2022 Mobile Shopping Cart X.X% Sales

Melina Tested Pattern #1: Remove Coupon Fields On Snocks.com

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

This experiment replaced a visible coupon field with a dynamic text link that would initially hide the form field. Only after clicking the text link would the coupon form field appear. The translation from German is "Do you have a coupon code? Click here to apply". Impact on completed transactions was measured.

Total Sample: 33,575 • Statistical Power at 5% MDE: 99.9%

Test #384 on Mariemur.com by Gleb HodorovskiyGleb Hodorovskiy Nov 17, 2021 Mobile Shopping Cart X.X% Sales

Gleb Tested Pattern #103: Money Back Guarantee On Mariemur.com

Pattern #103: Money Back Guarantee - Variant A
Pattern #103: Money Back Guarantee - Variant B

In this experiment from Conversionrate.store, a 14 day money back guarantee was added to a shopping cart of a lingerie online store. Secondary text further elaborated this with the following copy "Free returns if size doesn’t match". Impact on transactions was measured.

Total Sample: 93,248 • Statistical Power at 5% MDE: 37.3%

Test #377 on Adoramapix.com by Jakub LinowskiJakub Linowski Sep 30, 2021 Desktop Shopping Cart X.X% Sales

Jakub Tested Pattern #121: Free Shipping On Adoramapix.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this experiment, a big "free shipping" badge was added and defaulted to when available. Impact on progression to checkouts and completed sales was measured.

Total Sample: 4,422 • Statistical Power at 5% MDE: 85.5%

Test #278 by Someone Someone Jan 15, 2020 Mobile Shopping Cart X.X% Sales

Someone Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, multiple elemenets were removed from the bottom of the cart page. This was done to see if they were potential distractions that hindered the purchase process. The elements included such things as: Order details (visible on other pages), large product photo, a "what you receive" section with selling points, more reassurances, and a newsletter subscribe box.

Total Sample: 1,369 • Statistical Power at 5% MDE: 12%

Test #117 on Ssdnodes.com by Matt ConnorMatt Connor Oct 02, 2017 Desktop Shopping Cart X.X% Sales

Matt Tested Pattern #21: What It's Worth On Ssdnodes.com

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B
Total Sample: 4,000 • Statistical Power at 5% MDE: 7.9%

Test #88 on Ssdnodes.com by Matt ConnorMatt Connor Mar 31, 2017 Desktop Mobile Shopping Cart X.X% Progression

Matt Tested Pattern #21: What It's Worth On Ssdnodes.com

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B
Total Sample: 2,306 • Statistical Power at 5% MDE: 14.5%