All Latest 644 A/B Tests

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

This was a sibling experiment on another domain.

An additional step was added in a lead ffunnel with a question about the customer's desired "type of travel experience". Impact on lead rate was measured. (Desktop only)

An additional step was added in a lead ffunnel with a question about the customer's desired "type of travel experience". Impact on lead rate was measured.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

This was a sibling experiment on another domain.

This experiment ran on search results page of an ecommerce grocery store.

50% of users saw product cards that upon clicking would open in the same window (Control).

The other 50% saw product cards that upon clicking would open in a new tab/window (Treatment).

Impact on adds to cart and orders was measured.

We should also add that this experiment was run as part of the Trustworthy Replication Project and only "adds-to-cart" were pre-registered as the primary metric - https://osf.io/yu4gm/overview

In this mobile experiment, the A version contained two sticky/floating elements: the top navigation with a logo, and the bottom CTA. The variation only floated the bottom CTA, while the top logo var was using a default "static" position (disappearing on scroll like all other elements).

Impact on leads started and compelted was measured.

In this experiment, users were able to auto-generate gift messages during the checkout flow based on input fields above. For this reason, the message input area was also shifted further down beyond the initial fields.

In this experiment, instead of utilizing the browser auto-complete for the street address, the Google API call was made using the postal/zip code as the input. Once users would begin typing a street address, a pull-down with matching recommendations would appear. Impact on next step visits (to checkout) and sales were measured.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

In this experiment, when users added something to cart, they would be automatically sent to checkout (one step forward), instead of staying on the product page. Impact on checkout visits and sales was measured. The test was triggered to PDP page visits.

In this experiment (sibling of 656), a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, a sticky add-to-cart button was added to the floating page navigation after users scrolled past the midpoint of a long product page, at the same moment the navigation also became a floating element. After users clicked the button, it changed into a confirmation link labeled “Item added to cart,” with a link to checkout.

In this experiment, product configuration options were moved from a floating buy box on the right, to wards the center of the product page - increasing their prominence. Impact on adds to cart and sales was measured.

In this experiment, returning homepage users were shown their recently viewed items in a carousel (in the upper part of the homepage). Users who viewed at least 1 product were triggered into the experiment. Impact on adds to cart and sales was measured.

In this experiment, a red dot was added to the login link, along with a hover state that clarified the benefits of doing so. Impact on adds to cart and sales was measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

In this experiment, more popular search categories (pills) were shown on the homepage based on analyzed search volume. Impact on searches and email subscriptions were measured.

The A version showed a non-sticky checkout button at the bottom of a flyout cart. The B variation added a sticky bar with a price summary and checkout button, keeping it always visible. Impact on sales was measured.

The control had a clickable link "Use discount code" which would reveal an input field for a coupon code. The variation removed this link and input field. Impact on purchases was measured. (Desktop only)