All Latest 633 A/B Tests

MOST RECENT TESTS

Test #561 on Aboalarm.de by Katharina LayKatharina Lay Nov 07, 2024 Desktop Signup X.X% Sales

Katharina Tested Pattern #40: Blurred Product Background On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

Total Sample: 135,618 Statistical Power at 5% MDE: 98.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #560 on Finn.com by Daria KurchinskaiaDaria Kurchinskaia Oct 22, 2024 Mobile Desktop Checkout X.X% Signups

Daria Tested Pattern #46: Pay Later On Finn.com

 - Variant A
 - Variant B

The idea of this experiment was at least two fold. 1) the variation attempted to clarify that there is no payment today with the copy "Pay 0€ today" on the collapsed state of the payment amount. 2) clarify the payment terms with exact dates and amounts for future payments.

Total Sample: 2,052 Statistical Power at 5% MDE: 23.3%

Test #559 on Tourradar.com by Clemens GraveClemens Grave Oct 18, 2024 Desktop Listing X.X% Progression

Clemens Tested Pattern #137: Visible Filters On Tourradar.com

 - Variant A
 - Variant B

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

Total Sample: 36,470 Statistical Power at 5% MDE: 99.5%

Test #557 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Desktop Only)

Total Sample: 349,103 Statistical Power at 5% MDE: 23.6%

Test #558 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

Total Sample: 1,002,479 Statistical Power at 5% MDE: 33.6%

Test #556 on Snocks.com by Melina HessMelina Hess Oct 08, 2024 Mobile Product X.X% Sales

Melina Tested Pattern #65: Add More For Extra Incentive On Snocks.com

 - Variant A
 - Variant B

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Total Sample: 692,708 Statistical Power at 5% MDE: 99.9%

Test #554 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Desktop Only)

Total Sample: 127,871 Statistical Power at 5% MDE: 14.3%

Test #555 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)

Total Sample: 534,185 Statistical Power at 5% MDE: 36%

Test #553 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 27, 2024 Mobile Desktop Checkout X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

Test #552 on Tourradar.com by Clemens GraveClemens Grave Sep 19, 2024 Product X.X% Progression

Clemens Tested Pattern #15: Bulleted Reassurances On Tourradar.com

 - Variant A
 - Variant B

In this experiment, existing reassurance copy was changed. The control contained copy that focused on splitting payments and paying over time. The variation challenged this and showed a best price guarantee and the ability to earn credits. 

Total Sample: 432,567 Statistical Power at 5% MDE: 44.7%

Test #551 on Tourradar.com by Clemens GraveClemens Grave Sep 04, 2024 Desktop Product X.X% Progression

Clemens Tested Pattern #139: Page Level Navigation On Tourradar.com

 - Variant A
 - Variant B

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Total Sample: 70,793 Statistical Power at 5% MDE: 99.9%

Test #550 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2024 Mobile Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

 - Variant A
 - Variant B

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

Total Sample: 312,289 Statistical Power at 5% MDE: 35.2%

Test #548 on Livefresh.de by Melina HessMelina Hess Aug 13, 2024 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #17: Least Or Most Expensive First On Livefresh.de

 - Variant A
 - Variant B

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

Total Sample: 272,793 Statistical Power at 5% MDE: 88.8%

Test #549 on Kay.com by Craig KistlerCraig Kistler Aug 13, 2024 Desktop Listing X.X% Sales

Craig Tested Pattern #138: Visible Payment Options On Kay.com

 - Variant A
 - Variant B

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

Total Sample: 342,123 Statistical Power at 5% MDE: 22.7%

Test #547 on Aboalarm.de by Katharina LayKatharina Lay Aug 12, 2024 Mobile Signup X.X% Sales

Katharina Tested Pattern #6: Customer Star Ratings On Aboalarm.de

 - Variant A
 - Variant B

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

Total Sample: 102,221 Statistical Power at 5% MDE: 94.9%

Test #546 on Finn.com by Maksim Meged Maksim Meged Aug 01, 2024 Desktop Signup X.X% Signups

Maksim Tested Pattern #129: Right Or Left Aligned Forms On Finn.com

 - Variant A
 - Variant B

In this signup flow experiment, form fields on the right hand side (control) were shifted to the left column (variation). Impact on account creations and checkouts was measured.

Total Sample: 6,674 Statistical Power at 5% MDE: 14%

Test #545 on Banter.com by Craig KistlerCraig Kistler Jul 29, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power

Test #544 on 686.com by Adan ArchilaAdan Archila Jul 25, 2024 Desktop Product X.X% Sales

Adan Tested Pattern #104: Carousel Vs Static Grid Images On 686.com

 - Variant A
 - Variant B

In this experiment, a single image carousel gallery was replaced with a grid gallery. In addition the variation also used: taller swatches; a wider size box, added fit (slim, relaxed, straight, wide) options; and used a wider Add to Cart CTA (full width of the column). Impact on sales was measured.

Total Sample: 68,576 Statistical Power at 5% MDE: 20.3%

Test #543 on by Jakub LinowskiJakub Linowski Jul 22, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

In this experiment, social proof copy was added just below product photos. The copy emphasied that "3 million satisfied customers" and "10 million deliveries since 2003". Impact on sales was measured.

Total Sample: 36,948 Statistical Power at 5% MDE: 18.8%

Test #542 on Expertinstitute.com by Ardit VeliuArdit Veliu Jul 17, 2024 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #108: Frequently Asked Questions On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured.

Total Sample: 8,476 Statistical Power at 5% MDE: 10.6%