All Latest 617 A/B Tests

MOST RECENT TESTS

Test #527 on by Jakub LinowskiJakub Linowski Apr 23, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #132: One Time Payment Copy

 - Variant A
 - Variant B

In this experiment, copy related to payment duration types (paid in full or ongoing) was changed. In the the control, one of the option used the "Pay in Full" copy, whereas the variation changed this to "One-time payment". Impact on sales was measured.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #525 on by Jakub LinowskiJakub Linowski Mar 27, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

 - Variant A
 - Variant B

In this experiment, a club subscription duration was preselected to 6 in the variation. The control had no club durations preselected. As a result of preselecting a club duration, a more visible price also appeared at the top (sooner in the variation). Impact on sales was measured.

Test #523 on Livefresh.de by Pascal DietzPascal Dietz Mar 21, 2024 Mobile Product X.X% Sales

Pascal Tested Pattern #131: Authority On Livefresh.de

 - Variant A
 - Variant B

In this experiment, a photo of a doctor (who researched and created the a cleanising juice - the product) was appended after the add to cart button. The copy is translated as follows from "Von der promovierten Ernährungswissenschaftlerin Dr. Ulrike Fisher auf wissenschaftlicher Basis entwickelt." [German] -> "Developed by doctoral nutritionist Dr. Ulrike Fisher with a scientific basis." Impact on sales was measured.

Test #513 on Dripl.de by Jona EisenbergerJona Eisenberger Jan 23, 2024 Mobile Desktop Product X.X% Sales

Jona Tested Pattern #15: Bulleted Reassurances On Dripl.de

 - Variant A
 - Variant B

In this experiment of a floor cleaning product, a reassurance about product uses was appended to two cleaning agent upsells. In the control users saw the 2 standard upsells for laminate and tiles. And in the variation the copy "Right for me. 100x Cleanings" (uses) was appended. 

Test #512 on Snocks.com by Melina HessMelina Hess Jan 17, 2024 Mobile Product X.X% Sales

Melina Tested Pattern #65: Add More For Extra Incentive On Snocks.com

 - Variant A
 - Variant B

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Test #509 on Jared.com by Craig KistlerCraig Kistler Dec 18, 2023 Desktop Product X.X% Sales

Craig Tested Pattern #66: Complementary Upsell On Jared.com

 - Variant A
 - Variant B

In this experiment, a protection plan was launched as a modal for customers that clicked add-to-cart without choosing the upsell. Impact on adds-to-cart and sales was measured.

Test #508 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 15, 2023 Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, the variation transformed an add-to-cart button into a shopping cart one (making it a two step process). The control had an interaction where an add-to-cart button would become a quantity selection and then a shopping cart action (a three step process). In a way, the control kept users in a "dead-end" quantity selection middle state that required clicking the back button to continue the sale. Whereas the variation automatically moved users into the next step (closer towards being able to make a purchase). Impact on sales was measured. 

Test #506 on by Jakub LinowskiJakub Linowski Dec 07, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #4: Testimonials

 - Variant A
 - Variant B

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

Test #500 on Kayoutlet.com by Craig KistlerCraig Kistler Oct 25, 2023 Mobile Product X.X% Sales

Craig Tested Pattern #7: Social Counts On Kayoutlet.com

 - Variant A
 - Variant B

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

Test #498 on by Jakub LinowskiJakub Linowski Oct 19, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

Test #497 on Jared.com by Craig KistlerCraig Kistler Oct 16, 2023 Mobile Product X.X% Sales

Craig Tested Pattern #7: Social Counts On Jared.com

 - Variant A
 - Variant B

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

Test #496 on Livefresh.de by Pascal DietzPascal Dietz Oct 03, 2023 Desktop Mobile Product X.X% Sales

Pascal Tested Pattern #43: Long Titles On Livefresh.de

 - Variant A
 - Variant B

In this product detail page experiment a simple subheadline was appended to a new product. The tagline read "Lose weight sustainably and healthily." (Google translated from German "Nachhaltig und gesund Gewicht verlieren."). Impact on sales and revenue was measured.

Test #493 on by Jakub LinowskiJakub Linowski Sep 19, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #69: Autodiscounting

 - Variant A
 - Variant B

This experiment was technically a larger multi-change one that ran on product detail pages. The control showed an automatically applied coupon (for people opening up targeted emails with the discount). The variation attempted to make this better with the following changes:

  1. The discount message shifted closer towards the price / product selection (above the buy box)
  2. Removal of sale discount amounts and messages tied to longer durations (6 and 12 month duration)
  3. Reinforcing that the actual discount will be calculated further on checkout

Test #489 on by Jakub LinowskiJakub Linowski Aug 14, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #78: Tags, Badges And Structured Information

 - Variant A
 - Variant B

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

Test #488 on Metro-cc.ru by Andrey AndreevAndrey Andreev Aug 11, 2023 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Metro-cc.ru

 - Variant A
 - Variant B

In this experiment, customer reviews were shown on product detail pages. Impact on adds to cart and sales was measured.

Test #486 on Livefresh.de by Pascal DietzPascal Dietz Aug 03, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #78: Tags, Badges And Structured Information On Livefresh.de

 - Variant A
 - Variant B

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

Test #485 on Livefresh.de by Pascal DietzPascal Dietz Jul 27, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #131: Authority On Livefresh.de

 - Variant A
 - Variant B

In this experiment a juice cleanse product (developed by Dr. Ulrike Fischer) was supported with statements and visuals to reinforce her as a doctor and an authority figure. The control only referenced the product itself. Google translations include:

A) Headline: "Reset your body with a juice cleanse"

B) Headline: "The juice cleanse with a scientific basis" 

B) Listed out specific vitamins and supplements.

B) Added Subheadline: "Developed by Dr. Ulrike Fischer, who holds a doctorate in nutritional science" 

Test #484 on Snocks.com by Melina HessMelina Hess Jul 21, 2023 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #80: Persistent Filters On Snocks.com

 - Variant A
 - Variant B

In this experiment, the variation remembered and prefilled user's size choices for the duration of the session. The control version always started with a fixed product size value (ex: XS). The variation prefilled them between products or screen refreshes. Impact on sales was measured.

Test #477 on Snocks.com by Melina HessMelina Hess Jun 09, 2023 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #95: Clickable Product Previews On Snocks.com

 - Variant A
 - Variant B

In this experiment, product color swatches were replaced with real product photos. Whereas the control showed the colors as more abstract circles. Impact on sales was measured.

Test #476 on by Devesh KhanalDevesh Khanal Jun 08, 2023 Mobile Product X.X% Sales

Devesh Tested Pattern #95: Clickable Product Previews

 - Variant A
 - Variant B

The GrowthRock team ran an experiment on one of their client's product detail pages. Instead of using a scrollbar (for mulitple images), clickable product photo thumbnails were used instead. Impact on sales was measured.