All Latest 631 A/B Tests

Test #614 on Kay.com by Craig KistlerCraig Kistler Oct 23, 2025 Mobile Home & Landing X.X% Sales

Craig Tested Pattern #26: Cart Reminder And Recently Viewed On Kay.com

 - Variant A
 - Variant B

In this experiment, returning users to a homepage would be shown recently viewed items. Impact on adds to cart and sales was measured. The experiment was triggered to returning users.

Total Sample: 122,483 Statistical Power at 5% MDE: 58.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #613 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 30, 2025 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a series of brand logos with links to product listing pages were added - enabling another layer of search. Impact on products purchased was measured.

Total Sample: 1,716,300 Statistical Power at 5% MDE: 99.9%

Test #612 on by Frazer MawsonFrazer Mawson Sep 28, 2025 Mobile Checkout X.X% Sales

Frazer Tested Pattern #99: Progress Bar

 - Variant A
 - Variant B

In this experiment, a 3 step progress bar was added at the top of an ecommerce checkout funnel. Impact on checkout progression and completed sales was measured.

Total Sample: 43,113 Statistical Power at 5% MDE: 99.2%

Test #611 on Finn.com by Maksim Meged Maksim Meged Sep 24, 2025 Desktop Mobile Listing X.X% Sales

Maksim Tested Pattern #114: Less Or More Visible Prices On Finn.com

 - Variant A
 - Variant B

In this experiment, price was made more visible using size and a higher contrast color. Impact on progressions and bookings was measured.

Total Sample: 55,293 Statistical Power at 5% MDE: 5.3%

Test #610 on by Jakub LinowskiJakub Linowski Sep 04, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #111: Field Explanations

 - Variant A
 - Variant B

In this product detail page experiment, the variation showed a tooltip icon. Upon hovering on the icon it expanded additional information explaining the difference between pay in full and pay per shipment. Impact on sales was measured. 

Total Sample: 26,534 Statistical Power at 5% MDE: 15.7%

Test #609 on by Melina HessMelina Hess Aug 31, 2025 Mobile Product X.X% Sales

Melina Tested Pattern #46: Pay Later

 - Variant A
 - Variant B

In this experiment, a Klarna buy now pay later badge was added to the PDP. It was added above the paypal buy now pay later badge in the benefit section below the ATC button. Impact on adds to cart and sales was measured.

Total Sample: 364,582 Statistical Power at 5% MDE: 86.2%

Test #607 on Backstage.com by Stanley ZuoStanley Zuo Aug 26, 2025 Mobile Listing X.X% Sales

Stanley Tested Pattern #51: Shortcut Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, additional "apply" buttons were shown on listing tiles which lead users one step further in the application process. These buttons were also shown with multiple role details. Impact on progression and job application starts was measured.

Total Sample: 43,967 Statistical Power at 5% MDE: 7.1%

Test #606 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 22, 2025 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

Total Sample: 1,317,945 Statistical Power at 5% MDE: 79.3%

Test #604 on by Melina HessMelina Hess Jul 31, 2025 Mobile Product X.X% Sales

Melina Tested Pattern #46: Pay Later

 - Variant A
 - Variant B

In this experiment, a Paypal badge with "buy now pay later" copy (pay within 30 days) was added underneath the add-to-cart button on product pages. Impact on adds to cart and sales was measured.

Total Sample: 645,035 Statistical Power at 5% MDE: 99.9%

Test #603 on Kay.com by Craig KistlerCraig Kistler Jul 30, 2025 Desktop Mobile Product X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Kay.com

 - Variant A
 - Variant B

In this experiment, product pages (variant) asked users if they were interested to see holiday gifts with two buttons. Upon clicking "yes", the UI expanded to make another choice in order to see gifts for: Her, Him or Kids. Clicking any of these three would send users to dedicated listing pages with more product recommendations. Impact on sales was measured.

Total Sample: 3,080,311 Statistical Power at 5% MDE: 99.9%

Test #601 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 22, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, 4 selling points were added at the top of product details pages. Clicking on them would launch a modal with more details.

Total Sample: 481,189 Statistical Power at 5% MDE: 42.8%

Test #600 on by Jakub LinowskiJakub Linowski Jul 18, 2025 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #63: Trust Seals

 - Variant A
 - Variant B

In this experiment, 4 accepted credit card icons were added to an add-to-cart and checkout flow. Impact on sales was measured.

Total Sample: 7,986 Statistical Power at 5% MDE: 82.6%

Test #598 on by Jakub LinowskiJakub Linowski Jun 27, 2025 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

This experiment started when a user started a custom product build and visited any other product page. In the variation, a resume button appeared that would bring the customers back to their custom build. Impact on checkouts and sales was measured.

Total Sample: 1,177 Statistical Power at 5% MDE: 7.7%

Test #597 on by Frazer MawsonFrazer Mawson Jun 26, 2025 Mobile Product X.X% Sales

Frazer Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, a fixed add-to-cart button along with the quantity selector was transformed into an always floating one. Impact on sales was measured. (Visitors are session based).

Total Sample: 247,046 Statistical Power at 5% MDE: 58.2%

Test #596 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 24, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #7: Social Counts On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

Total Sample: 64,535 Statistical Power at 5% MDE: 8.8%

Test #595 on by Jakub LinowskiJakub Linowski Jun 09, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

 - Variant A
 - Variant B

In this mobile product page experiment, the variation changed the look of the floating button area once a product was chosen.

The variation showed a button with 1) pricing totals along with 2) a link back to the edit area and 3) a button that allowed to add to cart directly. Whereas the control only linked back to the top of the page where the product selction was possible. Impact on adds-to-cart and sales was measured.

Total Sample: 22,957 Statistical Power at 5% MDE: 12.9%

Test #594 on Obs.no by Joachim FurusethJoachim Furuseth May 28, 2025 Mobile Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,262,310 Statistical Power at 5% MDE: 99.9%

Test #593 on Obs.no by Joachim FurusethJoachim Furuseth May 27, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obs.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 694,658 Statistical Power at 5% MDE: 83.2%

Test #591 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Desktop Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 925,560 Statistical Power at 5% MDE: 70.3%

Test #592 on Obsbygg.no by Joachim FurusethJoachim Furuseth May 25, 2025 Mobile Product X.X% Sales

Joachim Tested Pattern #141: Square or Rounded Buttons On Obsbygg.no

 - Variant A
 - Variant B

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

Total Sample: 1,328,302 Statistical Power at 5% MDE: 96.3%