All Latest 634 A/B Tests

In this checkout funnel experiment, instead of showing order details and reassurances in a labeled key-value format (e.g., "Club Length: 6 Months"), they were condensed into an unlabeled bullet list. Media logo badges were also removed. Impact on checkouts and sales was measured.

In this experiment, instead of utilizing the browser auto-complete for the street address, the Google API call was made using the postal/zip code as the input. Once users would begin typing a street address, a pull-down with matching recommendations would appear. Impact on next step visits (to checkout) and sales were measured.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

In this experiment (sibling of 656), a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, an additional ongoing club was tested in a floating buy box on top of 4 other subscription durations. Impact on adds to cart and sales was measured.

In this experiment, product configuration options were moved from a floating buy box on the right, to wards the center of the product page - increasing their prominence. Impact on adds to cart and sales was measured.

In this experiment, returning homepage users were shown their recently viewed items in a carousel (in the upper part of the homepage). Users who viewed at least 1 product were triggered into the experiment. Impact on adds to cart and sales was measured.

In this experiment, a buy box layout without product choices, was laid out differently. In the control, it product options were shown as a vertical list, whereas in the variation they were turned into a 2x2 grid. Impact on adds to cart and sales were measured. (Mobile only)  

In this experiment, a buy box layout without product choices, was laid out differently. In the control, it product options were shown as a vertical list, whereas in the variation they were turned into a 2x2 grid. Impact on adds to cart and sales were measured.   

In this experiment, square buttons were changed to rounded ones throughout the full site. Impact on adds-to-cart was measured.

In this experiment, a red dot was added to the login link, along with a hover state that clarified the benefits of doing so. Impact on adds to cart and sales was measured.

In this experiment, a set of 5 alternative product recommendations were moved from the very bottom of the page (control) to the top (variation). These "You May Also Like " recommendations were moved just above the existing product descriptions. Impact on adds to cart and sales was measured.

In this experiment, a set of 5 alternative product recommendations were moved from the very bottom of the page (control) to the top (variation). These "You May Also Like " recommendations were moved just above the existing product descriptions. Impact on adds to cart and sales was measured.

The A version showed a non-sticky checkout button at the bottom of a flyout cart. The B variation added a sticky bar with a price summary and checkout button, keeping it always visible. Impact on sales was measured.

A global flyout drawer was added that consolidated sale promotions into one centralized location, replacing the customary placement of promotions throughout the site.

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Mobile only)