All Latest 594 A/B Tests

In this experiment, a breadcrumb was replaced with a circular progress bar (arguably more visible overall steps; but less visible/clickable accomplished steps). Impact on transactions was measured.

In this experiment, a horizontally scrolling set of products was replaced with an expanded and more visible grid of suggested products - enabling more discovery. 

In this experiment, reassuring copy was added to 2 of 3 pricing plans of a contract cancellation service. The copy was translated as "Cancellation guarantee. Contract cost coverage and legal support included!” Impact on overall revenue was measured.

In this experiment, the homepage interaction, headline, and images were changed. In the control, users saw a single “Shop Now” button leading directly to products. In the variation, users first chose between “Reset” or “Lose Weight,” then selected a duration in days before being shown products. The impact on sales was measured.

A progress bar was added to the top of a 3 step signup funnel. Impact on completed orders was measured.

A number of copy tweaks were made in this experiment which was flipped around to match the earliest availability pattern (one of the more visible changes). Under this assumption, one of the more visible copy changes is the switch from using a blue "Most popular" tag towards a green "Available from [DATE]". The "available from" is also visible in the other version, except further down and with lower contrast. Impact on adds to cart and orders was measured.

In this experiment, two sets of distractions were removed from the checkout put. First, the search bar was removed from the top of the screen. Second, a series of app links were also removed from the bottom of the screen near the footer. Impact on checkouts was measured.

In this experiment, returning users to a homepage would be shown recently viewed items. Impact on adds to cart and sales was measured. The experiment was triggered to returning users.

In this experiment, a 3 step progress bar was added at the top of an ecommerce checkout funnel. Impact on checkout progression and completed sales was measured.

In this experiment, price was made more visible using size and a higher contrast color. Impact on progressions and bookings was measured.

In this experiment, a Klarna buy now pay later badge was added to the PDP. It was added above the paypal buy now pay later badge in the benefit section below the ATC button. Impact on adds to cart and sales was measured.

In this experiment, a 3 step progress bar was added at the top of a signup funnel. Impact on signups was measured.

In this experiment, additional "apply" buttons were shown on listing tiles which lead users one step further in the application process. These buttons were also shown with multiple role details. Impact on progression and job application starts was measured.

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

A less expensive product choice (club duration) was added at the beginning of the options. Impact on adds-to-cart, sales and revenue were measured.

In this experiment, a Paypal badge with "buy now pay later" copy (pay within 30 days) was added underneath the add-to-cart button on product pages. Impact on adds to cart and sales was measured.

In this experiment, product pages (variant) asked users if they were interested to see holiday gifts with two buttons. Upon clicking "yes", the UI expanded to make another choice in order to see gifts for: Her, Him or Kids. Clicking any of these three would send users to dedicated listing pages with more product recommendations. Impact on sales was measured.

In this experiment, the control contained a headline with a somewhat ambiguous choice, asking users to "Login or Register". Whereas the variation communicated a simpler action headline: "Let's go". Down funnel impact was measured (post-registration) on product page views and adds to cart. (This also was an irregular split ratio; not a 50/50 split)

In this experiment, 4 accepted credit card icons were added to an add-to-cart and checkout flow. Impact on sales was measured.

This experiment started when a user started a custom product build and visited any other product page. In the variation, a resume button appeared that would bring the customers back to their custom build. Impact on checkouts and sales was measured.