All Latest 615 A/B Tests

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

This experiment was technically a larger multi-change one that ran on product detail pages. The control showed an automatically applied coupon (for people opening up targeted emails with the discount). The variation attempted to make this better with the following changes:

1. The discount message shifted closer towards the price / product selection (above the buy box)
2. Removal of sale discount amounts and messages tied to longer durations (6 and 12 month duration)
3. Reinforcing that the actual discount will be calculated further on checkout

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

In this experiment, customer reviews were shown on product detail pages. Impact on adds to cart and sales was measured.

In this experiment, selling points and benefits of a subscription were placed as bullets at the top of a checkout page. The benefits highlighted things such as: unlimited applications, access to vetted jobs and the ability to cancel anytime. Impact on sales was measured.

In this experiment, the choice of adding a product to cart was confirmed with a further positive message in the header of the next step (on the add to cart page). Once users left the product detail page, instead of simply stating the product name, the title was rephrased as "Product [X] Makes a Great Gift. They'll Love It!". I view this as a higher "intensity" experiment, given that the add-to-cart page was in some way already confirming the choice. Impact on sales was measured.

In this homepage experiment a number of changes were introduced - with perhaps the most prominent one being the replacement of a video component with customer review badges. Additional copy changes included reinforcement of the latest version number (v11) throughout the page, as well as a dedicated (v11) section in the middle of the page. Impact on demo signups was measured.

In this experiment, an FAQ section was added near the bottom of a long product page. The reviews were collapsed by default, but expandable upon clicking. Impact on adds-to-cart and sales was measured.

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

In this experiment, the footer was simplified with multiple elements being removed (catalog request, secondary links, and a guarantee). Additionally, a more prominent phone number was also displayed.

In this experiment, three testimonials were appended at the bottom of landing pages of a contract cancelation service (paid). These testimonials were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

In this experiment, four TrustPilot reviews were appended at the bottom of landing pages of a contract cancelation service (paid). These reviews were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

This experiment added a small nudge or callout to encourage more signups. Attention was directed towards the save function, which lead to the signup flow for anyone not signed it. Impact on signups was measured.

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.