All Latest 644 A/B Tests

Test #617 by Frazer MawsonFrazer Mawson Oct 30, 2025 Mobile Signup X.X% Sales

Frazer Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

A progress bar was added to the top of a 3 step signup funnel. Impact on completed orders was measured.

Total Sample: 59,317 • Statistical Power at 5% MDE: 92.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #614 on Kay.com by Craig KistlerCraig Kistler Oct 23, 2025 Mobile Home & Landing X.X% Sales

Craig Tested Pattern #26: Cart Reminder And Recently Viewed On Kay.com

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, returning users to a homepage would be shown recently viewed items. Impact on adds to cart and sales was measured. The experiment was triggered to returning users.

Total Sample: 122,483 • Statistical Power at 5% MDE: 58.1%

Test #613 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 30, 2025 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, a series of brand logos with links to product listing pages were added - enabling another layer of search. Impact on products purchased was measured.

Total Sample: 1,716,300 • Statistical Power at 5% MDE: 99.9%

Test #612 by Frazer MawsonFrazer Mawson Sep 28, 2025 Mobile Checkout X.X% Sales

Frazer Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a 3 step progress bar was added at the top of an ecommerce checkout funnel. Impact on checkout progression and completed sales was measured.

Total Sample: 43,113 • Statistical Power at 5% MDE: 99.2%

Test #610 by Jakub LinowskiJakub Linowski Sep 04, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #111: Field Explanations

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this product detail page experiment, the variation showed a tooltip icon. Upon hovering on the icon it expanded additional information explaining the difference between pay in full and pay per shipment. Impact on sales was measured. 

Total Sample: 26,534 • Statistical Power at 5% MDE: 15.7%

Test #608 by Frazer MawsonFrazer Mawson Aug 28, 2025 Mobile Signup X.X% Signups

Frazer Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a 3 step progress bar was added at the top of a signup funnel. Impact on signups was measured.

Total Sample: 64,980 • Statistical Power at 5% MDE: 25.9%

Test #606 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 22, 2025 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Online.metro-cc.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

Total Sample: 1,317,945 • Statistical Power at 5% MDE: 79.3%

Test #605 by Jakub LinowskiJakub Linowski Aug 21, 2025 Desktop Mobile Product X.X% Revenue

Jakub Tested Pattern #113: More Or Fewer Plans

Pattern #113: More Or Fewer Plans - Variant A
Pattern #113: More Or Fewer Plans - Variant B

A less expensive product choice (club duration) was added at the beginning of the options. Impact on adds-to-cart, sales and revenue were measured.

Test #604 by Melina HessMelina Hess Jul 31, 2025 Mobile Product X.X% Sales

Melina Tested Pattern #46: Pay Later

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B

In this experiment, a Paypal badge with "buy now pay later" copy (pay within 30 days) was added underneath the add-to-cart button on product pages. Impact on adds to cart and sales was measured.

Total Sample: 645,035 • Statistical Power at 5% MDE: 99.9%

Test #603 on Kay.com by Craig KistlerCraig Kistler Jul 30, 2025 Desktop Mobile Product X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Kay.com

Pattern #55: Conversational Filters - Variant A
Pattern #55: Conversational Filters - Variant B

In this experiment, product pages (variant) asked users if they were interested to see holiday gifts with two buttons. Upon clicking "yes", the UI expanded to make another choice in order to see gifts for: Her, Him or Kids. Clicking any of these three would send users to dedicated listing pages with more product recommendations. Impact on sales was measured.

Total Sample: 3,080,311 • Statistical Power at 5% MDE: 99.9%

Test #601 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 22, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 4 selling points were added at the top of product details pages. Clicking on them would launch a modal with more details.

Total Sample: 481,189 • Statistical Power at 5% MDE: 42.8%

Test #600 by Jakub LinowskiJakub Linowski Jul 18, 2025 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #63: Trust Seals

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B

In this experiment, 4 accepted credit card icons were added to an add-to-cart and checkout flow. Impact on sales was measured.

Total Sample: 7,986 • Statistical Power at 5% MDE: 82.6%

Test #598 by Jakub LinowskiJakub Linowski Jun 27, 2025 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

This experiment started when a user started a custom product build and visited any other product page. In the variation, a resume button appeared that would bring the customers back to their custom build. Impact on checkouts and sales was measured.

Total Sample: 1,177 • Statistical Power at 5% MDE: 7.7%

Test #596 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 24, 2025 Desktop Product X.X% Sales

Andrey Tested Pattern #7: Social Counts On Online.metro-cc.ru

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

Total Sample: 64,535 • Statistical Power at 5% MDE: 8.8%

Test #590 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 15, 2025 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

Total Sample: 275,410 • Statistical Power at 5% MDE: 38.8%

Test #589 by Jakub LinowskiJakub Linowski Apr 30, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #68: Welcome Discount

Pattern #68: Welcome Discount - Variant A
Pattern #68: Welcome Discount - Variant B

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

Total Sample: 23,605 • Statistical Power at 5% MDE: 17.5%

Test #588 on Hellostake.com by Louis AlstonLouis Alston Apr 28, 2025 Mobile Global X.X% Sales

Louis Tested Pattern #26: Cart Reminder And Recently Viewed On Hellostake.com

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

This experiment started right after users of a trading app received trade order expiry notification (for a security trading app). In the control, after clicking the notifications, users would have to navigate to the trade themselves. In the variation, 1) an additional step was added which informed what happened (an order was not place and expired) and 2) they were automatically send to the order page. Impact on orders placed was measured.

Total Sample: 5,551 • Statistical Power at 5% MDE: 42.8%

Test #586 by Jakub LinowskiJakub Linowski Apr 25, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages (below the buy box). After pressing play, the video started playing with a visible "close" control to allow stopping of the video.

Impact on adds to cart and sales was measured.

Total Sample: 4,828 • Statistical Power at 5% MDE: 6.7%

Test #585 on Jared.com by Craig KistlerCraig Kistler Apr 10, 2025 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #137: Visible Filters On Jared.com

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

In this experiment, UI filters with metal color options were surfaced at the top of product listing pages (for Jared - an online jewelry retailer). Impact on filter usage, adds to cart and sales were measured.

Total Sample: 33,984 • Statistical Power at 5% MDE: 7.6%

Test #584 on Snocks.com by Melina HessMelina Hess Mar 31, 2025 Mobile Listing X.X% Sales

Melina Tested Pattern #6: Customer Star Ratings On Snocks.com

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

Total Sample: 379,243 • Statistical Power at 5% MDE: 99.9%