All Latest 633 A/B Tests

Test #582 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Mar 22, 2025 Desktop Mobile Listing X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

Total Sample: 1,242,470 Statistical Power at 5% MDE: 89.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #581 on Asics.com by Andrey ProkhorovAndrey Prokhorov Mar 21, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #104: Carousel Vs Static Grid Images On Asics.com

 - Variant A
 - Variant B

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

Total Sample: 163,627 Statistical Power at 5% MDE: 80.4%

Test #580 on Finn.com by Tim KarcherTim Karcher Mar 06, 2025 Mobile Signup X.X% Signups

Tim Tested Pattern #91: Forced Action On Finn.com

 - Variant A
 - Variant B

In this experiment, the control shows an (X) close option within a signup flow, whereas the variation had it removed. Clicking the close icon would collapse the signup modal and show the product page. Users were still able use the back and forward functionality.

(The test was inversed in order to fit the pattern). Impact on signups was measured.

Total Sample: 36,898 Statistical Power at 5% MDE: 99.8%

Test #579 on Jared.com by Craig KistlerCraig Kistler Feb 23, 2025 Mobile Product X.X% Sales

Craig Tested Pattern #21: What It's Worth On Jared.com

 - Variant A
 - Variant B

In this experiment, typical dollar values of typical coverages for an extended protection plan were shown. This ran on a product page of a jewelery site. Impact on on adds to cart, sales and uptake of the upsell was measured. Traffic split was 25/75.

Total Sample: 2,285,675 Statistical Power at 5% MDE: 21.2%

Test #575 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Desktop Listing X.X% Leads

Tim Tested Pattern #34: Open In A New Tab On Finn.com

 - Variant A
 - Variant B

In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signups and sales was measured.

Total Sample: 37,497 Statistical Power at 5% MDE: 9.1%

Test #576 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Mobile Listing X.X% Leads

Tim Tested Pattern #34: Open In A New Tab On Finn.com

 - Variant A
 - Variant B
Total Sample: 66,947 Statistical Power at 5% MDE: 12.5%

Test #571 on by Jakub LinowskiJakub Linowski Jan 03, 2025 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

 - Variant A
 - Variant B

In this experiment, additional customer product photos were shown at the top of the product page. A "Show More Photos" button was also added which launched a modal with additional and larger images. Impact on sales was measured.

Total Sample: 71,218 Statistical Power at 5% MDE: 51.1%

Test #570 on Livefresh.de by Melina HessMelina Hess Dec 30, 2024 Desktop Mobile Home & Landing X.X% Sales

Melina Tested Pattern #79: Product Highlights On Livefresh.de

 - Variant A
 - Variant B

In this experiment, three popular juice products were shown higher on the variation (instead of lower in the control). Impact on sales was measured.

Total Sample: 149,200 Statistical Power at 5% MDE: 99.3%

Test #566 on Banter.com by Craig KistlerCraig Kistler Dec 11, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power

Test #565 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Nov 30, 2024 Desktop Home & Landing X.X% Leads

Lars Tested Pattern #129: Right Or Left Aligned Forms On Umbraco.com

 - Variant A
 - Variant B

In this experiment, the right vs left position of a form (at the bottom of a landing page) was a/b tested. Impact on progression and form completion was measured.

Total Sample: 5,654 Statistical Power at 5% MDE: 3.9%

Test #564 on Hellostake.com by Louis AlstonLouis Alston Nov 26, 2024 Desktop Mobile Home & Landing X.X% Signups

Louis Tested Pattern #114: Less Or More Visible Prices On Hellostake.com

 - Variant A
 - Variant B

In this a/b test, the headline was changed to reflect pricing information (informing that trades are starting at $3). Impact on progression and signups was measured.

Total Sample: 25,321 Statistical Power at 5% MDE: 6.5%

Test #561 on Aboalarm.de by Katharina LayKatharina Lay Nov 07, 2024 Desktop Signup X.X% Sales

Katharina Tested Pattern #40: Blurred Product Background On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

Total Sample: 135,618 Statistical Power at 5% MDE: 98.7%

Test #560 on Finn.com by Daria KurchinskaiaDaria Kurchinskaia Oct 22, 2024 Mobile Desktop Checkout X.X% Signups

Daria Tested Pattern #46: Pay Later On Finn.com

 - Variant A
 - Variant B

The idea of this experiment was at least two fold. 1) the variation attempted to clarify that there is no payment today with the copy "Pay 0€ today" on the collapsed state of the payment amount. 2) clarify the payment terms with exact dates and amounts for future payments.

Total Sample: 2,052 Statistical Power at 5% MDE: 23.3%

Test #559 on Tourradar.com by Clemens GraveClemens Grave Oct 18, 2024 Desktop Listing X.X% Progression

Clemens Tested Pattern #137: Visible Filters On Tourradar.com

 - Variant A
 - Variant B

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

Total Sample: 36,470 Statistical Power at 5% MDE: 99.5%

Test #556 on Snocks.com by Melina HessMelina Hess Oct 08, 2024 Mobile Product X.X% Sales

Melina Tested Pattern #65: Add More For Extra Incentive On Snocks.com

 - Variant A
 - Variant B

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Total Sample: 692,708 Statistical Power at 5% MDE: 99.9%

Test #552 on Tourradar.com by Clemens GraveClemens Grave Sep 19, 2024 Product X.X% Progression

Clemens Tested Pattern #15: Bulleted Reassurances On Tourradar.com

 - Variant A
 - Variant B

In this experiment, existing reassurance copy was changed. The control contained copy that focused on splitting payments and paying over time. The variation challenged this and showed a best price guarantee and the ability to earn credits. 

Total Sample: 432,567 Statistical Power at 5% MDE: 44.7%

Test #550 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2024 Mobile Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

 - Variant A
 - Variant B

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

Total Sample: 312,289 Statistical Power at 5% MDE: 35.2%

Test #548 on Livefresh.de by Melina HessMelina Hess Aug 13, 2024 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #17: Least Or Most Expensive First On Livefresh.de

 - Variant A
 - Variant B

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

Total Sample: 272,793 Statistical Power at 5% MDE: 88.8%

Test #546 on Finn.com by Maksim Meged Maksim Meged Aug 01, 2024 Desktop Signup X.X% Signups

Maksim Tested Pattern #129: Right Or Left Aligned Forms On Finn.com

 - Variant A
 - Variant B

In this signup flow experiment, form fields on the right hand side (control) were shifted to the left column (variation). Impact on account creations and checkouts was measured.

Total Sample: 6,674 Statistical Power at 5% MDE: 14%

Test #545 on Banter.com by Craig KistlerCraig Kistler Jul 29, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power