All Latest 610 A/B Tests

In this experiment, UI filters with metal color options were surfaced at the top of product listing pages (for Jared - an online jewelry retailer). Impact on filter usage, adds to cart and sales were measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

In this experiment, the control shows an (X) close option within a signup flow, whereas the variation had it removed. Clicking the close icon would collapse the signup modal and show the product page. Users were still able use the back and forward functionality.

(The test was inversed in order to fit the pattern). Impact on signups was measured.

In this experiment, typical dollar values of typical coverages for an extended protection plan were shown. This ran on a product page of a jewelery site. Impact on on adds to cart, sales and uptake of the upsell was measured. Traffic split was 25/75.

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video started playing with the controls only appearing for a short time before fading away.

Notice the confounding from pushing the buy box further down.

Impact on adds to cart and sales was measured.

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

In this experiment from GuessTheTest.com, the control variation only showed the primary add-to-cart button further down on the page. The variation however turned the button into a floating one once users scrolled on the page. Impact on button clicks was measured.

In this experiment, additional customer product photos were shown at the top of the product page. A "Show More Photos" button was also added which launched a modal with additional and larger images. Impact on sales was measured.

In this experiment, three popular juice products were shown higher on the variation (instead of lower in the control). Impact on sales was measured.

In this experiment, reaffirming copy was added for particular size options in the variation. Here is the translation from German:

"These boxer shorts will be kept. Did you know that our boxer shorts in S are rarely returned? They fit perfectly - see for yourself!"

Impact on sales was measured.

In this experiment, the variation added popular categories with links at the top of the homepage. This was done for all sets of user segments: new and returning. Impact on transactions was measured.

In this a/b test, the headline was changed to reflect pricing information (informing that trades are starting at $3). Impact on progression and signups was measured.

In this experiment, a 3 step progress bar was added starting on a checkout funnel (dedicated add-to-cart page, greeting card step and order summary). The progress bar also showed any completed steps as a "checked off" state. More so, users were able to use the progress bar as a navigation item to any previously completed and currently active steps. Impact on sales was measured.

The idea of this experiment was at least two fold. 1) the variation attempted to clarify that there is no payment today with the copy "Pay 0€ today" on the collapsed state of the payment amount. 2) clarify the payment terms with exact dates and amounts for future payments.

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping.