All Latest 639 A/B Tests

This experiment ran on an ecommerce store utilizing Shopify's checkout. The treatment showed a single testimonial and impact on placed orders was measured. The A/B test ran using PrettyDamnQuick software.

In this experiment, users were able to auto-generate gift messages during the checkout flow based on input fields above. For this reason, the message input area was also shifted further down beyond the initial fields.

In this checkout funnel experiment, instead of showing order details and reassurances in a labeled key-value format (e.g., "Club Length: 6 Months"), they were condensed into an unlabeled bullet list. Media logo badges were also removed. Impact on checkouts and sales was measured.

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

In this experiment, a larger vs smaller font size for the yearly price was tested. Impact on annual subscription clicks was measured. (The experiment has been inverted to fit the pattern.)

In this experiment, different reassurance messages were shown at the bottom of the add-to-cart widget on a product page. The variation emphasized full refunds for faulty or misrepresented items.

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.

In this experiment, a pricing table (an upsell of product protection plan coverages) was tested against a more explicit yes/no toggle for including the plan. Impact was measured on adds to cart, orders, and upsell rate, using an 80/20 traffic split.

A number of copy tweaks were made in this experiment which was flipped around to match the earliest availability pattern (one of the more visible changes). Under this assumption, one of the more visible copy changes is the switch from using a blue "Most popular" tag towards a green "Available from [DATE]". The "available from" is also visible in the other version, except further down and with lower contrast. Impact on adds to cart and orders was measured.

In this experiment, a Klarna buy now pay later badge was added to the PDP. It was added above the paypal buy now pay later badge in the benefit section below the ATC button. Impact on adds to cart and sales was measured.

In this experiment, a Paypal badge with "buy now pay later" copy (pay within 30 days) was added underneath the add-to-cart button on product pages. Impact on adds to cart and sales was measured.

In this experiment, the control contained a headline with a somewhat ambiguous choice, asking users to "Login or Register". Whereas the variation communicated a simpler action headline: "Let's go". Down funnel impact was measured (post-registration) on product page views and adds to cart. (This also was an irregular split ratio; not a 50/50 split)

In this experiment, 4 selling points were added at the top of product details pages. Clicking on them would launch a modal with more details.

In this experiment, 4 accepted credit card icons were added to an add-to-cart and checkout flow. Impact on sales was measured.

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

In this experiment, typical dollar values of typical coverages for an extended protection plan were shown. This ran on a product page of a jewelery site. Impact on on adds to cart, sales and uptake of the upsell was measured. Traffic split was 25/75.

In this experiment, reaffirming copy was added for particular size options in the variation. Here is the translation from German:

"These boxer shorts will be kept. Did you know that our boxer shorts in S are rarely returned? They fit perfectly - see for yourself!"

Impact on sales was measured.