All Latest 617 A/B Tests

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

This experiment ran on desktop only, on all our regular product listing and search result page. In the control, clicking on products would open them up in the same page, whereas in the variation, the links opened in a new tab. Impact on adds-to-cart were measured.

In this experiment, the sorting link (defaulting to popular) was swapped with the filter one. In the control, the sorting appeared on the left with the filter on the right, whereas in the variation these two were flipped. Impact on adds to cart and sales were measured.

In this experiment, search results and listing pages received two additional filters to remove out-of-stock and in-store-only items. This reduced the number of results shown by default. The impact on add-to-cart actions, checkout flows, and completed sales was measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this experiment, a static category theme image at the top of a listing page was tested against the same page but without the extra image. Impact on sales was measured.

In this experiment, the effect of having additional static category themed images was tested on category listing pages. Impact on sales was measured.

In this desktop experiment, 4 product tiles per page (control) were tested against 6. Impact on sales was measured.

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.

In this experiment, a two column grid layout (control) was tested against single column layout (variation) with the product information shown to the right. Please note that the screenshot shows repeated products only because it's been sourced from a Figma design file. In reality, the products in the variation were equally diverse as in the control. 

(We've also flipped the A and B to match up with our grid pattern.)

Are more (popular) product results better than none at all? In this experiment, popular products were shown during an empty search result. Impact on sales was measured.