All Latest 634 A/B Tests

MOST RECENT TESTS

Test #593 on Obs.no by Joachim FurusethJoachim Furuseth May 27, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 694,658 Statistical Power at 5% MDE: 83.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #591 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 925,560 Statistical Power at 5% MDE: 70.3%

Test #590 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 15, 2025 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

Total Sample: 275,410 Statistical Power at 5% MDE: 38.8%

Test #589 on by Jakub LinowskiJakub Linowski Apr 30, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #68: Welcome Discount

 - Variant A
 - Variant B

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

Total Sample: 23,605 Statistical Power at 5% MDE: 17.5%

Test #587 on https://asics.com App by Andrey ProkhorovAndrey Prokhorov Apr 26, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #140: Product Descriptions

 - Variant A
 - Variant B

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

Total Sample: 164,018 Statistical Power at 5% MDE: 79.9%

Test #585 on Jared.com by Craig KistlerCraig Kistler Apr 10, 2025 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #137: Visible Filters On Jared.com

 - Variant A
 - Variant B

In this experiment, UI filters with metal color options were surfaced at the top of product listing pages (for Jared - an online jewelry retailer). Impact on filter usage, adds to cart and sales were measured.

Total Sample: 33,984 Statistical Power at 5% MDE: 7.6%

Test #583 on Backstage.com by Stanley ZuoStanley Zuo Mar 30, 2025 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #24: Visible Availability On Backstage.com

 - Variant A
 - Variant B

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

Total Sample: 279,266 Statistical Power at 5% MDE: 15%

Test #582 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Mar 22, 2025 Desktop Mobile Listing X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

Total Sample: 1,242,470 Statistical Power at 5% MDE: 89.1%

Test #581 on Asics.com by Andrey ProkhorovAndrey Prokhorov Mar 21, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #104: Carousel Vs Static Grid Images On Asics.com

 - Variant A
 - Variant B

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

Total Sample: 163,627 Statistical Power at 5% MDE: 80.4%

Test #577 on by Jakub LinowskiJakub Linowski Feb 19, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

 - Variant A
 - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video expanded to a full column width (taking over the middle column while replacing the 5 small square photo tiles and growing in height.) The video in its play state also contained a prominent (X) icon that allowed users to stop and revert to the original state.

Impact on adds to cart and sales was measured.

Total Sample: 18,143 Statistical Power at 5% MDE: 27%

Test #575 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Desktop Listing X.X% Leads

Tim Tested Pattern #34: Open In A New Tab On Finn.com

 - Variant A
 - Variant B

In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signups and sales was measured.

Total Sample: 37,497 Statistical Power at 5% MDE: 9.1%

Test #571 on by Jakub LinowskiJakub Linowski Jan 03, 2025 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

 - Variant A
 - Variant B

In this experiment, additional customer product photos were shown at the top of the product page. A "Show More Photos" button was also added which launched a modal with additional and larger images. Impact on sales was measured.

Total Sample: 71,218 Statistical Power at 5% MDE: 51.1%

Test #570 on Livefresh.de by Melina HessMelina Hess Dec 30, 2024 Desktop Mobile Home & Landing X.X% Sales

Melina Tested Pattern #79: Product Highlights On Livefresh.de

 - Variant A
 - Variant B

In this experiment, three popular juice products were shown higher on the variation (instead of lower in the control). Impact on sales was measured.

Total Sample: 149,200 Statistical Power at 5% MDE: 99.3%

Test #567 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 18, 2024 Mobile Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the variation added popular categories with links at the top of the homepage. This was done for all sets of user segments: new and returning. Impact on transactions was measured.

Total Sample: 474,550 Statistical Power at 5% MDE: 22.6%

Test #566 on Banter.com by Craig KistlerCraig Kistler Dec 11, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power

Test #565 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Nov 30, 2024 Desktop Home & Landing X.X% Leads

Lars Tested Pattern #129: Right Or Left Aligned Forms On Umbraco.com

 - Variant A
 - Variant B

In this experiment, the right vs left position of a form (at the bottom of a landing page) was a/b tested. Impact on progression and form completion was measured.

Total Sample: 5,654 Statistical Power at 5% MDE: 3.9%

Test #564 on Hellostake.com by Louis AlstonLouis Alston Nov 26, 2024 Desktop Mobile Home & Landing X.X% Signups

Louis Tested Pattern #114: Less Or More Visible Prices On Hellostake.com

 - Variant A
 - Variant B

In this a/b test, the headline was changed to reflect pricing information (informing that trades are starting at $3). Impact on progression and signups was measured.

Total Sample: 25,321 Statistical Power at 5% MDE: 6.5%

Test #563 on Expertinstitute.com by Ardit VeliuArdit Veliu Nov 19, 2024 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #108: Frequently Asked Questions On Expertinstitute.com

 - Variant A
 - Variant B

In this RETEST experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured. It was also triggered by users who scrolled at least 100px downwards towards the FAQ section.

Total Sample: 6,383 Statistical Power at 5% MDE: 9.3%

Test #562 on by Jakub LinowskiJakub Linowski Nov 13, 2024 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

 - Variant A
 - Variant B

In this experiment, a 3 step progress bar was added starting on a checkout funnel (dedicated add-to-cart page, greeting card step and order summary). The progress bar also showed any completed steps as a "checked off" state. More so, users were able to use the progress bar as a navigation item to any previously completed and currently active steps. Impact on sales was measured.

Total Sample: 2,313 Statistical Power at 5% MDE: 28.2%

Test #561 on Aboalarm.de by Katharina LayKatharina Lay Nov 07, 2024 Desktop Signup X.X% Sales

Katharina Tested Pattern #40: Blurred Product Background On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

Total Sample: 135,618 Statistical Power at 5% MDE: 98.7%