All Latest 625 A/B Tests

In this experiment, the height of a sticky call to action was decreased on mobile devices. To accomplish this change, a text phone number was also turned into an icon and its position was shifted. For extra context, the landing page also displayed numerous tiles, each with their own and repeated calls to action. Impact on leads was measured.     

In this experiment, returning homepage users were shown their recently viewed items in a carousel (in the upper part of the homepage). Users who viewed at least 1 product were triggered into the experiment. Impact on adds to cart and sales was measured.

In this experiment, a buy box layout without product choices, was laid out differently. In the control, it product options were shown as a vertical list, whereas in the variation they were turned into a 2x2 grid. Impact on adds to cart and sales were measured. (Mobile only)  

In this experiment, square buttons were changed to rounded ones throughout the full site. Impact on adds-to-cart was measured.

In this experiment, a red dot was added to the login link, along with a hover state that clarified the benefits of doing so. Impact on adds to cart and sales was measured.

In this experiment, a set of 5 alternative product recommendations were moved from the very bottom of the page (control) to the top (variation). These "You May Also Like " recommendations were moved just above the existing product descriptions. Impact on adds to cart and sales was measured.

In this experiment, more popular search categories (pills) were shown on the homepage based on analyzed search volume. Impact on searches and email subscriptions were measured.

The A version showed a non-sticky checkout button at the bottom of a flyout cart. The B variation added a sticky bar with a price summary and checkout button, keeping it always visible. Impact on sales was measured.

A global flyout drawer was added that consolidated sale promotions into one centralized location, replacing the customary placement of promotions throughout the site.

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

A floating Add to Basket button was added to a product page. Impact on sales was measured.

In this experiment, the sorting link (defaulting to popular) was swapped with the filter one. In the control, the sorting appeared on the left with the filter on the right, whereas in the variation these two were flipped. Impact on adds to cart and sales were measured.

In this experiment, a larger vs smaller font size for the yearly price was tested. Impact on annual subscription clicks was measured. (The experiment has been inverted to fit the pattern.)

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)

In this experiment, different reassurance messages were shown at the bottom of the add-to-cart widget on a product page. The variation emphasized full refunds for faulty or misrepresented items.

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.

In this experiment, the shopping cart screen displayed a floating “Checkout” button with common credit card icons that directed users to the checkout page when clicked. In the control, the button was positioned inline, further down the page. Impact on progression to checkout and total sales were measured.

In this experiment, a pricing table (an upsell of product protection plan coverages) was tested against a more explicit yes/no toggle for including the plan. Impact was measured on adds to cart, orders, and upsell rate, using an 80/20 traffic split.

In this experiment (1) the zip code field position was moved up, right below the last name. And (2) entering the zip code would populate the state and city using an autofill API call. Impact on orders completed was measured.

In this experiment, two types of UI filters for metal color choices were shown at the top of product listing pages. One variant only used category labels, while the other variant combined images with labels to reinforce the categories. Impact on filter usage, adds to cart and sales were measured.