All Latest 571 A/B Tests

This experiment started when a user started a custom product build and visited any other product page. In the variation, a resume button appeared that would bring the customers back to their custom build. Impact on checkouts and sales was measured.

This is a heavily confounded multi-change experiment. In the variation, product choices on product detail pages were taken off and moved to a 2nd step (a new step). This also resulted in the price and primary button becoming more visible from an upward position shift. Impact on adds-to-cart and lead generation was measured.

In this experiment, a fixed add-to-cart button along with the quantity selector was transformed into an always floating one. Impact on sales was measured. (Visitors are session based).

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

In this mobile product page experiment, the variation changed the look of the floating button area once a product was chosen.

The variation showed a button with 1) pricing totals along with 2) a link back to the edit area and 3) a button that allowed to add to cart directly. Whereas the control only linked back to the top of the page where the product selction was possible. Impact on adds-to-cart and sales was measured.

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, add-to-cart buttons on product details pages were rounded to 20px (variation), whereas the control had square buttons. Impact on adds to cart and purchases were measured.

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

This experiment added one extra layer of persistence to an appearing welcome discount offer. In the variation, a welcome discount appeared on product pages after some inactivity behavior combined with a delay. In the variation, the only thing that was modified was the "collapse" behavior - basically creating a small floating micro modal in the bottom right. The micro modal allowed users to return to the larger modal or collaping it for good (with a second X collapse button). Impact on sales was measured.

This experiment started right after users of a trading app received trade order expiry notification (for a security trading app). In the control, after clicking the notifications, users would have to navigate to the trade themselves. In the variation, 1) an additional step was added which informed what happened (an order was not place and expired) and 2) they were automatically send to the order page. Impact on orders placed was measured.

In this experiment, product descriptions were moved up on the page and expanded by default. As a result, related and product recommendation were pushed further down on the page. Impact on ATC and sales was measured.

In this experiment, a video unboxing and product overview video was added on product pages (below the buy box). After pressing play, the video started playing with a visible "close" control to allow stopping of the video.

Impact on adds to cart and sales was measured.

In this experiment, UI filters with metal color options were surfaced at the top of product listing pages (for Jared - an online jewelry retailer). Impact on filter usage, adds to cart and sales were measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, the active availability of a casting call (job offer) was was made more prominent using green text: "Accepting applications". The variation also made the "Join Now" button more prominent as an alternative path to signing up for a membership. The experiment reports on three metrics: clicks on apply, application starts and premium membership sales (measured a few steps further in the funnel).

In this experiment, the plus and minus quantity icons near the add to cart button were made more visible. In the variation they gained a higher contrast from a full background color. Impact on add to cart and sales was measured.

More product photos were exposed in the main column of the variation. Treatment used a collapsed gallery. Impact on ATC and sales was measured.

In this experiment, the control shows an (X) close option within a signup flow, whereas the variation had it removed. Clicking the close icon would collapse the signup modal and show the product page. Users were still able use the back and forward functionality.

(The test was inversed in order to fit the pattern). Impact on signups was measured.