All Latest 539 A/B Tests

In this experiment, a two column grid layout (control) was tested against single column layout (variation) with the product information shown to the right. Please note that the screenshot shows repeated products only because it's been sourced from a Figma design file. In reality, the products in the variation were equally diverse as in the control. 

(We've also flipped the A and B to match up with our grid pattern.)

In this experiment, instead of showing 12 products per screen (with pagination), the variation showed all 42 products on a single screen. Impact on adds to cart and completed orders was measured.

In this experiment, the wording "one-time payment" was appended below all three pricing plans for a contract cancelation service. Impact on orders placed was measured. (Translated from German: "Einmalige Zahlung").

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

In this experiment, a progress bar was added to a signup flow of a mental health app. It appeared on numerous steps of a onboarding flow. Impact on signup completions and checkouts was measured.

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

In this product detail page experiment a simple subheadline was appended to a new product. The tagline read "Lose weight sustainably and healthily." (Google translated from German "Nachhaltig und gesund Gewicht verlieren."). Impact on sales and revenue was measured.

In this experiment two sections of a form on a single page (control) were broken out into 2 separate steps (variation). The two sections included personal details and shipping information. This step appeared after having received a product recommendation when filling out a questionnaire for a skin care product. Impact on next step progression and purchases was measured.

In this experiment, recently purchased products were appended at the top of the homepage. The test ran for loggedin users only. Impact on add-to-cart, sales and revenue was measured.

This experiment was technically a larger multi-change one that ran on product detail pages. The control showed an automatically applied coupon (for people opening up targeted emails with the discount). The variation attempted to make this better with the following changes:

1. The discount message shifted closer towards the price / product selection (above the buy box)
2. Removal of sale discount amounts and messages tied to longer durations (6 and 12 month duration)
3. Reinforcing that the actual discount will be calculated further on checkout

This experiment was a retest of a previously tested test 491. Simiarly, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow in the variation. 

In this experiment, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow. In the control version, the photo with introduction was only shown on the first screen. In the variation, the photo appeared on the first and all other screens - reinforcing expertise, authority and the idea of a consultation. Impact on signups and purchases was measured.

In this experiment, a section dedicated to choosing gift messages was taken out and separated into its own individial step. The change happened on the first step of a checkout flow and increased the flow by an additional step. Impact on checkouts and total sales was measured.

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

In this experiment, customer reviews were shown on product detail pages. Impact on adds to cart and sales was measured.

In this experiment, a "save 50%" badge was replaced with a "most popular" one with the intent of encouraging more users to select the higher priced plan. Impact on total and annual trial starts was measured.

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

In this experiment a juice cleanse product (developed by Dr. Ulrike Fischer) was supported with statements and visuals to reinforce her as a doctor and an authority figure. The control only referenced the product itself. Google translations include:

A) Headline: "Reset your body with a juice cleanse"

B) Headline: "The juice cleanse with a scientific basis" 

B) Listed out specific vitamins and supplements.

B) Added Subheadline: "Developed by Dr. Ulrike Fischer, who holds a doctorate in nutritional science" 

In this experiment, the variation remembered and prefilled user's size choices for the duration of the session. The control version always started with a fixed product size value (ex: XS). The variation prefilled them between products or screen refreshes. Impact on sales was measured.