All Latest 523 A/B Tests

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this signup flow experiment, form fields on the right hand side (control) were shifted to the left column (variation). Impact on account creations and checkouts was measured.

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

In this experiment, a single image carousel gallery was replaced with a grid gallery. In addition the variation also used: taller swatches; a wider size box, added fit (slim, relaxed, straight, wide) options; and used a wider Add to Cart CTA (full width of the column). Impact on sales was measured.

In this experiment, social proof copy was added just below product photos. The copy emphasied that "3 million satisfied customers" and "10 million deliveries since 2003". Impact on sales was measured.

In this experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured.

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

In this experiment, the earliest availability dates were displayed underneath product tiles on listing pages. This was a/b tested on a car rental service website. Impact on product adds-to-cart as well as transactions was measured.

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

In this experiment, a simple product category link was added on product detail pages. These links linked to listing pages with more of a similar product type. Impact on sales was measured.

In this experiment, the order of the checkout flow was rearranged. In the control the first step of the checkout flow started with the shipping information step, followed by greeting card selection. In the variation this was rearranged (hypothesis was that the greeting card step was easier). Impact on sales was measured.

In this experiment, a static category theme image at the top of a listing page was tested against the same page but without the extra image. Impact on sales was measured.

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.

In this experiment, the presence of a search bar was tested against no search bar altogether. The control had search, and in the variation it was removed. The variation also exposed items from within the "Need Help?" menu, making "My account", "Contact Us" and "FAQ" more prominent.

(Here the AB test is inverted / flipped to match the pattern). 

In this experiment, infinite scrolling was a/b tested against a paginated one.