All Latest 645 A/B Tests

Test #584 on Snocks.com by Melina HessMelina Hess Mar 31, 2025 Mobile Listing X.X% Sales

Melina Tested Pattern #6: Customer Star Ratings On Snocks.com

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

Total Sample: 379,243 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #578 by Jakub LinowskiJakub Linowski Feb 20, 2025 Mobile Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video started playing with the controls only appearing for a short time before fading away.

Notice the confounding from pushing the buy box further down.

Impact on adds to cart and sales was measured.

Total Sample: 21,142 • Statistical Power at 5% MDE: 21.6%

Test #577 by Jakub LinowskiJakub Linowski Feb 19, 2025 Desktop Product X.X% Sales

Jakub Tested Pattern #48: Video Testimonials

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video expanded to a full column width (taking over the middle column while replacing the 5 small square photo tiles and growing in height.) The video in its play state also contained a prominent (X) icon that allowed users to stop and revert to the original state.

Impact on adds to cart and sales was measured.

Total Sample: 18,143 • Statistical Power at 5% MDE: 27%

Test #574 on Myer.com.au by Jay KimJay Kim Jan 30, 2025 Mobile Product X.X% Sales

Jay Tested Pattern #41: Sticky Call To Action On Myer.com.au

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

Total Sample: 524,153 • Statistical Power at 5% MDE: 93.9%

Test #573 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 28, 2025 Mobile Shopping Cart X.X% Sales

Andrey Tested Pattern #41: Sticky Call To Action On Online.metro-cc.ru

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

Total Sample: 6,527 • Statistical Power at 5% MDE: 41.6%

Test #572 by Deborah O'MalleyDeborah O'Malley Jan 27, 2025 Mobile Product X.X% Progression

Deborah Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment from GuessTheTest.com, the control variation only showed the primary add-to-cart button further down on the page. The variation however turned the button into a floating one once users scrolled on the page. Impact on button clicks was measured.

Total Sample: 1,320 • Statistical Power at 5% MDE: 21.5%

Test #569 on Snocks.com by Melina HessMelina Hess Dec 29, 2024 Mobile Product X.X% Sales

Melina Tested Pattern #124: Confirmed Selection On Snocks.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, reaffirming copy was added for particular size options in the variation. Here is the translation from German:

"These boxer shorts will be kept. Did you know that our boxer shorts in S are rarely returned? They fit perfectly - see for yourself!"

Impact on sales was measured.

Total Sample: 269,954 • Statistical Power at 5% MDE: 99.9%

Test #567 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 18, 2024 Mobile Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, the variation added popular categories with links at the top of the homepage. This was done for all sets of user segments: new and returning. Impact on transactions was measured.

Total Sample: 474,550 • Statistical Power at 5% MDE: 22.6%

Test #563 on Expertinstitute.com by Ardit VeliuArdit Veliu Nov 19, 2024 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #108: Frequently Asked Questions On Expertinstitute.com

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

In this RETEST experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured. It was also triggered by users who scrolled at least 100px downwards towards the FAQ section.

Total Sample: 6,383 • Statistical Power at 5% MDE: 9.3%

Test #557 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Desktop Only)

Total Sample: 349,103 • Statistical Power at 5% MDE: 23.6%

Test #558 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

Total Sample: 1,002,479 • Statistical Power at 5% MDE: 33.6%

Test #554 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Desktop Only)

Total Sample: 127,871 • Statistical Power at 5% MDE: 14.3%

Test #555 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)

Total Sample: 534,185 • Statistical Power at 5% MDE: 36%

Test #553 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 27, 2024 Mobile Desktop Checkout X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Online.metro-cc.ru

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

Test #551 on Tourradar.com by Clemens GraveClemens Grave Sep 04, 2024 Desktop Product X.X% Progression

Clemens Tested Pattern #139: Page Level Navigation On Tourradar.com

Pattern #139: Page Level Navigation - Variant A
Pattern #139: Page Level Navigation - Variant B

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Total Sample: 70,793 • Statistical Power at 5% MDE: 99.9%

Test #549 on Kay.com by Craig KistlerCraig Kistler Aug 13, 2024 Desktop Listing X.X% Sales

Craig Tested Pattern #138: Visible Payment Options On Kay.com

Pattern #138: Visible Payment Options - Variant A
Pattern #138: Visible Payment Options - Variant B

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

Total Sample: 342,123 • Statistical Power at 5% MDE: 22.7%

Test #547 on Aboalarm.de by Katharina LayKatharina Lay Aug 12, 2024 Mobile Signup X.X% Sales

Katharina Tested Pattern #6: Customer Star Ratings On Aboalarm.de

Pattern #6: Customer Star Ratings - Variant A
Pattern #6: Customer Star Ratings - Variant B

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

Total Sample: 102,221 • Statistical Power at 5% MDE: 94.9%

Test #543 by Jakub LinowskiJakub Linowski Jul 22, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, social proof copy was added just below product photos. The copy emphasied that "3 million satisfied customers" and "10 million deliveries since 2003". Impact on sales was measured.

Total Sample: 36,948 • Statistical Power at 5% MDE: 18.8%

Test #542 on Expertinstitute.com by Ardit VeliuArdit Veliu Jul 17, 2024 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #108: Frequently Asked Questions On Expertinstitute.com

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

In this experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured.

Total Sample: 8,476 • Statistical Power at 5% MDE: 10.6%

Test #540 on Finn.com by Maksim Meged Maksim Meged Jun 28, 2024 Mobile Listing X.X% Sales

Maksim Tested Pattern #136: Earliest Availability On Finn.com

Pattern #136: Earliest Availability - Variant A
Pattern #136: Earliest Availability - Variant B

In this experiment, the earliest availability dates were displayed underneath product tiles on listing pages. This was a/b tested on a car rental service website. Impact on product adds-to-cart as well as transactions was measured.

Total Sample: 47,251 • Statistical Power at 5% MDE: 5.6%