All Latest 534 A/B Tests

In this experiment, a feint gray background search bar was replaced with a higher contrast one containing a blue border and a filled blue color button style.  Impact on searches and purchases was measured. (Inverted to fit the Filled-vs-ghost button pattern).

In this experiment, a club subscription duration was preselected to 6 in the variation. The control had no club durations preselected. As a result of preselecting a club duration, a more visible price also appeared at the top (sooner in the variation). Impact on sales was measured.

In this experiment, additional (discounted) products were shown at the top of category listing pages with a link to see more such products ("View All Price Drops"). Impact on overall sales was measured.

In this experiment, a photo of a doctor (who researched and created the a cleanising juice - the product) was appended after the add to cart button. The copy is translated as follows from "Von der promovierten Ernährungswissenschaftlerin Dr. Ulrike Fisher auf wissenschaftlicher Basis entwickelt." [German] -> "Developed by doctoral nutritionist Dr. Ulrike Fisher with a scientific basis." Impact on sales was measured.

This experiment was triggered by a small segment of users who completed the first step of checkout funnel (submitted email, name, phone number), but dropped from checkout and returned to cars catalogue 7 or more minutes later.

In the control, users didn't see any cart icon nor function to resume their checkout flow.

In the variation however, users saw a filled shopping cart icon with resume functionality. Clicking on the icon would guide and redirect users to their latest abandoned stage of their checkout flow.

This experiment started when users would click add-to-cart on product detail pages. In both the control and variation, a modal would appear. In the control the modal contained a "View Cart and Checkout" button that lead users to the cart page. In the variation the modal showed separate "View Cart" and "Checkout" buttons. The a/b test variation also introduced a green confirmation message about the product being added to cart. Impact on transactions and revenue was measured.
 

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

This was an experiment on the first checkout step where users would enter shipping information. The control had a longer footer with more additional sitewide links and a call to action to a newsletter. The variation removed these elements and kept the focus on the shipping information task. Impact on progression to next step and sales was measured.

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

In this experiment, people who saw an offer (in an email or popup) would see a more visible site wide reinforcement of their earned discount being active. In the control, the discount was only shown during checkout. In the variation, it was shown throughout the web site on the homepage and product detail pages.

In this experiment of a floor cleaning product, a reassurance about product uses was appended to two cleaning agent upsells. In the control users saw the 2 standard upsells for laminate and tiles. And in the variation the copy "Right for me. 100x Cleanings" (uses) was appended. 

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

In this experiment, users that did not complete a purchase and came back to the homepage were shown two different experiences. In the control, users would see the homepage (essentially having to restart the purchase flow). Whereas, in the variation, users would be shown a "Welcome Back" summary view with the completed steps shown as completed and a quick resume button to the next incomplete step. Impact on completed sales was measured.

In this experiment, the variation transformed an add-to-cart button into a shopping cart one (making it a two step process). The control had an interaction where an add-to-cart button would become a quantity selection and then a shopping cart action (a three step process). In a way, the control kept users in a "dead-end" quantity selection middle state that required clicking the back button to continue the sale. Whereas the variation automatically moved users into the next step (closer towards being able to make a purchase). Impact on sales was measured. 

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

In this experiment, new paywall copy and messaging was used to encourage more users to signup and pay for access to a mental health app. The variation reinforced that users would be receiving a full featured application, with reminders about the upcoming billing. It reinforced that users will have a full week to decide and potentially cancel their application. Impact on lagging +7 day later transactions was measured.

In this experiment, the cheapest pricing plan was removed from a set of 2 options. This only left the most expensive pricing plan as the option. Impact on sales and revenue was measured.

In this experiment, a two column grid layout (control) was tested against single column layout (variation) with the product information shown to the right. Please note that the screenshot shows repeated products only because it's been sourced from a Figma design file. In reality, the products in the variation were equally diverse as in the control. 

(We've also flipped the A and B to match up with our grid pattern.)

In this experiment, instead of showing 12 products per screen (with pagination), the variation showed all 42 products on a single screen. Impact on adds to cart and completed orders was measured.