All Latest 650 A/B Tests

Test #595 by Jakub LinowskiJakub Linowski Jun 09, 2025 Mobile Product X.X% Progression

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this mobile product page experiment, the variation changed the look of the floating button area once a product was chosen.

The variation showed a button with 1) pricing totals along with 2) a link back to the edit area and 3) a button that allowed to add to cart directly. Whereas the control only linked back to the top of the page where the product selction was possible. Impact on adds-to-cart and sales was measured.

Total Sample: 22,957 • Statistical Power at 5% MDE: 12.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #594 on Obs.no by Joachim FurusethJoachim Furuseth May 28, 2025 Mobile Product X.X% Progression

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

Pattern #141: Square or Rounded Buttons - Variant A
Pattern #141: Square or Rounded Buttons - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,262,310 • Statistical Power at 5% MDE: 99.9%

Test #593 on Obs.no by Joachim FurusethJoachim Furuseth May 27, 2025 Desktop Product X.X% Progression

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

Pattern #141: Square or Rounded Buttons - Variant A
Pattern #141: Square or Rounded Buttons - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 694,658 • Statistical Power at 5% MDE: 83.2%

Test #592 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Mobile Product X.X% Progression

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

Pattern #141: Square or Rounded Buttons - Variant A
Pattern #141: Square or Rounded Buttons - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,328,302 • Statistical Power at 5% MDE: 96.3%

Test #591 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Desktop Product X.X% Progression

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

Pattern #141: Square or Rounded Buttons - Variant A
Pattern #141: Square or Rounded Buttons - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 925,560 • Statistical Power at 5% MDE: 70.3%

Test #590 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 15, 2025 Desktop Home & Landing X.X% Progression

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

Total Sample: 275,410 • Statistical Power at 5% MDE: 38.8%

Test #589 by Jakub LinowskiJakub Linowski Apr 30, 2025 Desktop Product X.X% Progression

Jakub Tested Pattern #68: Welcome Discount

Pattern #68: Welcome Discount - Variant A
Pattern #68: Welcome Discount - Variant B

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

Total Sample: 23,605 • Statistical Power at 5% MDE: 17.5%

Test #587 on Asics.com by Andrey ProkhorovAndrey Prokhorov Apr 26, 2025 Desktop Product X.X% Progression

Andrey Tested Pattern #140: Product Descriptions

Pattern #140: Product Descriptions - Variant A
Pattern #140: Product Descriptions - Variant B

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

Total Sample: 164,018 • Statistical Power at 5% MDE: 79.9%

Test #586 by Jakub LinowskiJakub Linowski Apr 25, 2025 Mobile Product X.X% Progression

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages (below the buy box). After pressing play, the video started playing with a visible "close" control to allow stopping of the video.

Impact on adds to cart and sales was measured.

Total Sample: 4,828 • Statistical Power at 5% MDE: 6.7%

Test #585 on Jared.com by Craig KistlerCraig Kistler Apr 10, 2025 Mobile Desktop Listing X.X% Progression

Craig Tested Pattern #137: Visible Filters On Jared.com

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

In this experiment, UI filters with metal color options were surfaced at the top of product listing pages (for Jared - an online jewelry retailer). Impact on filter usage, adds to cart and sales were measured.

Total Sample: 33,984 • Statistical Power at 5% MDE: 7.6%

Test #583 on Backstage.com by Stanley ZuoStanley Zuo Mar 30, 2025 Desktop Mobile Listing X.X% Progression

Stanley Tested Pattern #24: Visible Availability On Backstage.com

Pattern #24: Visible Availability - Variant A
Pattern #24: Visible Availability - Variant B

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

Total Sample: 279,266 • Statistical Power at 5% MDE: 15%

Test #582 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Mar 22, 2025 Desktop Mobile Listing X.X% Progression

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

Total Sample: 1,242,470 • Statistical Power at 5% MDE: 89.1%

Test #581 on Asics.com by Andrey ProkhorovAndrey Prokhorov Mar 21, 2025 Desktop Product X.X% Progression

Andrey Tested Pattern #104: Carousel Vs Static Grid Images On Asics.com

Pattern #104: Carousel Vs Static Grid Images - Variant A
Pattern #104: Carousel Vs Static Grid Images - Variant B

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

Total Sample: 163,627 • Statistical Power at 5% MDE: 80.4%

Test #579 on Jared.com by Craig KistlerCraig Kistler Feb 23, 2025 Mobile Product X.X% Progression

Craig Tested Pattern #21: What It's Worth On Jared.com

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experiment, typical dollar values of typical coverages for an extended protection plan were shown. This ran on a product page of a jewelery site. Impact on on adds to cart, sales and uptake of the upsell was measured. Traffic split was 25/75.

Total Sample: 2,285,675 • Statistical Power at 5% MDE: 21.2%

Test #578 by Jakub LinowskiJakub Linowski Feb 20, 2025 Mobile Product X.X% Progression

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video started playing with the controls only appearing for a short time before fading away.

Notice the confounding from pushing the buy box further down.

Impact on adds to cart and sales was measured.

Total Sample: 21,142 • Statistical Power at 5% MDE: 21.6%

Test #577 by Jakub LinowskiJakub Linowski Feb 19, 2025 Desktop Product X.X% Progression

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video expanded to a full column width (taking over the middle column while replacing the 5 small square photo tiles and growing in height.) The video in its play state also contained a prominent (X) icon that allowed users to stop and revert to the original state.

Impact on adds to cart and sales was measured.

Total Sample: 18,143 • Statistical Power at 5% MDE: 27%

Test #575 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Desktop Listing X.X% Progression

Tim Tested Pattern #34: Open In A New Tab On Finn.com

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signups and sales was measured.

Total Sample: 37,497 • Statistical Power at 5% MDE: 9.1%

Test #576 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Mobile Listing X.X% Progression

Tim Tested Pattern #34: Open In A New Tab On Finn.com

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B
Total Sample: 66,947 • Statistical Power at 5% MDE: 12.5%

Test #574 on Myer.com.au by Jay KimJay Kim Jan 30, 2025 Mobile Product X.X% Progression

Jay Tested Pattern #41: Sticky Call To Action On Myer.com.au

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

Total Sample: 524,153 • Statistical Power at 5% MDE: 93.9%

Test #573 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 28, 2025 Mobile Shopping Cart X.X% Progression

Andrey Tested Pattern #41: Sticky Call To Action On Online.metro-cc.ru

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

Total Sample: 6,527 • Statistical Power at 5% MDE: 41.6%