All Latest 617 A/B Tests

MOST RECENT TESTS

Test #508 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 15, 2023 Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the variation transformed an add-to-cart button into a shopping cart one (making it a two step process). The control had an interaction where an add-to-cart button would become a quantity selection and then a shopping cart action (a three step process). In a way, the control kept users in a "dead-end" quantity selection middle state that required clicking the back button to continue the sale. Whereas the variation automatically moved users into the next step (closer towards being able to make a purchase). Impact on sales was measured. 

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #506 on by Jakub LinowskiJakub Linowski Dec 07, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #4: Testimonials

 - Variant A
 - Variant B

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

Test #500 on Kayoutlet.com by Craig KistlerCraig Kistler Oct 25, 2023 Mobile Product X.X% Sales

Craig Tested Pattern #7: Social Counts On Kayoutlet.com

 - Variant A
 - Variant B

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

Test #498 on by Jakub LinowskiJakub Linowski Oct 19, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

Test #497 on Jared.com by Craig KistlerCraig Kistler Oct 16, 2023 Mobile Product X.X% Sales

Craig Tested Pattern #7: Social Counts On Jared.com

 - Variant A
 - Variant B

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

Test #496 on Livefresh.de by Pascal DietzPascal Dietz Oct 03, 2023 Desktop Mobile Product X.X% Sales

Pascal Tested Pattern #43: Long Titles On Livefresh.de

 - Variant A
 - Variant B

In this product detail page experiment a simple subheadline was appended to a new product. The tagline read "Lose weight sustainably and healthily." (Google translated from German "Nachhaltig und gesund Gewicht verlieren."). Impact on sales and revenue was measured.

Test #493 on by Jakub LinowskiJakub Linowski Sep 19, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #69: Autodiscounting

 - Variant A
 - Variant B

This experiment was technically a larger multi-change one that ran on product detail pages. The control showed an automatically applied coupon (for people opening up targeted emails with the discount). The variation attempted to make this better with the following changes:

  1. The discount message shifted closer towards the price / product selection (above the buy box)
  2. Removal of sale discount amounts and messages tied to longer durations (6 and 12 month duration)
  3. Reinforcing that the actual discount will be calculated further on checkout

Test #489 on by Jakub LinowskiJakub Linowski Aug 14, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #78: Tags, Badges And Structured Information

 - Variant A
 - Variant B

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

Test #486 on Livefresh.de by Pascal DietzPascal Dietz Aug 03, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #78: Tags, Badges And Structured Information On Livefresh.de

 - Variant A
 - Variant B

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

Test #485 on Livefresh.de by Pascal DietzPascal Dietz Jul 27, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #131: Authority On Livefresh.de

 - Variant A
 - Variant B

In this experiment a juice cleanse product (developed by Dr. Ulrike Fischer) was supported with statements and visuals to reinforce her as a doctor and an authority figure. The control only referenced the product itself. Google translations include:

A) Headline: "Reset your body with a juice cleanse"

B) Headline: "The juice cleanse with a scientific basis" 

B) Listed out specific vitamins and supplements.

B) Added Subheadline: "Developed by Dr. Ulrike Fischer, who holds a doctorate in nutritional science" 

Test #484 on Snocks.com by Melina HessMelina Hess Jul 21, 2023 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #80: Persistent Filters On Snocks.com

 - Variant A
 - Variant B

In this experiment, the variation remembered and prefilled user's size choices for the duration of the session. The control version always started with a fixed product size value (ex: XS). The variation prefilled them between products or screen refreshes. Impact on sales was measured.

Test #477 on Snocks.com by Melina HessMelina Hess Jun 09, 2023 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #95: Clickable Product Previews On Snocks.com

 - Variant A
 - Variant B

In this experiment, product color swatches were replaced with real product photos. Whereas the control showed the colors as more abstract circles. Impact on sales was measured.

Test #476 on by Devesh KhanalDevesh Khanal Jun 08, 2023 Mobile Product X.X% Sales

Devesh Tested Pattern #95: Clickable Product Previews

 - Variant A
 - Variant B

The GrowthRock team ran an experiment on one of their client's product detail pages. Instead of using a scrollbar (for mulitple images), clickable product photo thumbnails were used instead. Impact on sales was measured.

Test #462 on by Jakub LinowskiJakub Linowski Mar 24, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #128: Standard Or Superscript Price Format

 - Variant A
 - Variant B

In this experiment, standard $ signs and cents were formatted into a smaller superscript. Impact on add-to-cart and sales was measured.

Test #461 on Snocks.com by Melina HessMelina Hess Mar 23, 2023 Mobile Product X.X% Sales

Melina Tested Pattern #15: Bulleted Reassurances On Snocks.com

 - Variant A
 - Variant B

In this product detail page experiment, reassurances under the add-to-cart button were rearranged. The control contained copy about: free shipping and free returns formatted as two gray boxes, with a variety of payment methods and their corresponding logos underneath.

The variation used a more convention bulleted, line-by-line format. It also contained free shipping and returns, but also elaborated with "100 day returns", an "anti-hole guarantee", and "purchase with invoice" (perhaps more popular in Germany?). Impact on sales was measured.

Test #449 on Snocks.com by Melina HessMelina Hess Dec 31, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #78: Tags, Badges And Structured Information On Snocks.com

 - Variant A
 - Variant B

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

Test #448 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 30, 2022 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #21: What It's Worth On Zapimoveis.com.br

 - Variant A
 - Variant B

In this experiment, the B variation showed the relative discount in price from within the most recent 12 months as a percentage point. A tooltip was also shown which explained this message on hover. 

Test #446 on by Jakub LinowskiJakub Linowski Dec 15, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #18: Single Or Alternative Buttons

 - Variant A
 - Variant B

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Test #444 on by Melina HessMelina Hess Nov 30, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, a floating add-to-cart with two product choices (color and size) were added on a product page. This appeared only after scrolling past the existing / embedded product selection buy box.

The floating add-to-cart widget had another layer of complexity in that it allowed customers to make a size and color selection with an expandable fly out. Making a selection would also append the total price to the add-to-cart button label.

Impact on total transactions was measured.

Test #441 on by Melina HessMelina Hess Nov 23, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, a floating sticky bar was added on product pages. The sticky elements only appeared after users scrolled beyond the fixed buy box  area that is relatively high on the page (visible on the control screenshot). The sticky bar contained three elements: a button to configure up to three product choices, a flavor selection pulldown, and the add-to-cart button. 

In the variation, when users clicked on the flavor pulldown three things happened. First, they were anchored back to the top of the buy box. Second, the floating sticky disappeared. And third, the flavors pulldown automatically expanded (overlapping the original primary add-to-cart button).

The control did not have any of the sticky behaviors.

Impact to total sales was measured.