All Latest 610 A/B Tests

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. 

Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.

In this experiment, a video unboxing and product overview video was added on product pages. After pressing play, the video expanded to a full column width (taking over the middle column while replacing the 5 small square photo tiles and growing in height.) The video in its play state also contained a prominent (X) icon that allowed users to stop and revert to the original state.

Impact on adds to cart and sales was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this experiment, a photo of a doctor (who researched and created the a cleanising juice - the product) was appended after the add to cart button. The copy is translated as follows from "Von der promovierten Ernährungswissenschaftlerin Dr. Ulrike Fisher auf wissenschaftlicher Basis entwickelt." [German] -> "Developed by doctoral nutritionist Dr. Ulrike Fisher with a scientific basis." Impact on sales was measured.

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

In this experiment, a social proof message was added below add to cart buttons on product detail pages. The copy read "Hurry, X people have viewed this product". Impact on adds to cart and transactions was measured.

In this experiment, 9 Twitter card style testimonials were appended onto the homepage of Rollbar. These were image / screenshots recreations without links to the actual tweets.

In this experiment, very short form testimonials (with a reference to over 3 million customers) were replaced with 3 more elaborate ones. These elaborate or benefit testimonials contained: highlighted statements, star reviews, emphasized location, tag summaries and photos of the purchased product. The control also contained a 3 testimonial carousel interaction.

This test appeared at the bottom of a longer homepage with additional product listings above.

In this experiment, a video testimonial was added mid page onto a signup / lead form page.

In this experiment, three video testimonials were added mid page onto a signup / lead form page.

In this homepage experiment a number of changes were introduced - with perhaps the most prominent one being the replacement of a video component with customer review badges. Additional copy changes included reinforcement of the latest version number (v11) throughout the page, as well as a dedicated (v11) section in the middle of the page. Impact on demo signups was measured.

In this experiment, a social proof popups were added to the signup / funnel pages for a contract cancellation service. The added social testimonials appeared as other customers used the service, anywhere except on the final checkout page. Additionaly, the interval at which these messaged appeared was 60 seconds, and they were shown for 10s. The messages translated to "[Name] had recently canncelled a contract with [Company], in the last 38 minutes". Impact on sales was measured.

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

In this experiment, three testimonials were appended at the bottom of landing pages of a contract cancelation service (paid). These testimonials were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

In this experiment, four TrustPilot reviews were appended at the bottom of landing pages of a contract cancelation service (paid). These reviews were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

In this experiment, social proof and scarcity messages were shown on a course enrollment landing page. When students were starting to sign up at the beginning of each month (with greater availability), a simpler "X students have already enrolled in the next cohort" message was used.

Later in the month when fewer spots were available, a more scarce message was used with the following copy "ONLY X SPOTS available in the next cohort".

In both cases, the numbers were accurate and dynamically updated.