All Latest 622 A/B Tests

In this experiment, a red dot was added to the login link, along with a hover state that clarified the benefits of doing so. Impact on adds to cart and sales was measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

In this experiment, more popular search categories (pills) were shown on the homepage based on analyzed search volume. Impact on searches and email subscriptions were measured.

In this experiment, the shopping cart screen displayed a floating “Checkout” button with common credit card icons that directed users to the checkout page when clicked. In the control, the button was positioned inline, further down the page. Impact on progression to checkout and total sales were measured.

In this experiment, a pricing table (an upsell of product protection plan coverages) was tested against a more explicit yes/no toggle for including the plan. Impact was measured on adds to cart, orders, and upsell rate, using an 80/20 traffic split.

In this experiment, search results and listing pages received two additional filters to remove out-of-stock and in-store-only items. This reduced the number of results shown by default. The impact on add-to-cart actions, checkout flows, and completed sales was measured.

In this experiment, returning users to a homepage would be shown recently viewed items. Impact on adds to cart and sales was measured. The experiment was triggered to returning users.

In this experiment, a 3 step progress bar was added at the top of an ecommerce checkout funnel. Impact on checkout progression and completed sales was measured.

In this experiment, a 3 step progress bar was added at the top of a signup funnel. Impact on signups was measured.

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

In this experiment from GuessTheTest.com, the control variation only showed the primary add-to-cart button further down on the page. The variation however turned the button into a floating one once users scrolled on the page. Impact on button clicks was measured.

In this experiment, "persistence" of 4 product choices was added in the variation. When users made a product selection such as: duration, payment terms, starting month or shipping frequency, their choices were remembered and defaulted on next visits, reloads or when viewing other products. Impact on adds to cart and sales was measured.

In this experiment, a 3 step progress bar was added starting on a checkout funnel (dedicated add-to-cart page, greeting card step and order summary). The progress bar also showed any completed steps as a "checked off" state. More so, users were able to use the progress bar as a navigation item to any previously completed and currently active steps. Impact on sales was measured.

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.