All Latest 539 A/B Tests

In this experiment, selling points and benefits of a subscription were placed as bullets at the top of a checkout page. The benefits highlighted things such as: unlimited applications, access to vetted jobs and the ability to cancel anytime. Impact on sales was measured.

In this experiment, the choice of adding a product to cart was confirmed with a further positive message in the header of the next step (on the add to cart page). Once users left the product detail page, instead of simply stating the product name, the title was rephrased as "Product [X] Makes a Great Gift. They'll Love It!". I view this as a higher "intensity" experiment, given that the add-to-cart page was in some way already confirming the choice. Impact on sales was measured.

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. Benefit items not included in the lower plans were also shown with grayed out styles (and an "x"). Clearly the higher paid plan had all the benefits listed. Impact on transactions was measured. 

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. The lowest plan only had one benefit, whereas the highest plan had 3. Impact on transactions was measured. 

In this experiment, an offers page was shifted all the way down inside an expanded mobile navigation. The control showed it at the very top. The variation showed it at the bottom. (Note that  the screen shot shows an already scrolled navigation - in the initial view, users would not be able to see the discount page right away, as it required some scrolling). Impact on overall sales was measured.

In this experiment, product color swatches were replaced with real product photos. Whereas the control showed the colors as more abstract circles. Impact on sales was measured.

The GrowthRock team ran an experiment on one of their client's product detail pages. Instead of using a scrollbar (for mulitple images), clickable product photo thumbnails were used instead. Impact on sales was measured.

Are more (popular) product results better than none at all? In this experiment, popular products were shown during an empty search result. Impact on sales was measured.

In this experiment, 9 Twitter card style testimonials were appended onto the homepage of Rollbar. These were image / screenshots recreations without links to the actual tweets.

In this experiment, a video testimonial was added mid page onto a signup / lead form page.

In this experiment, three video testimonials were added mid page onto a signup / lead form page.

In this experiment, a password field was removed from a signup / account creation step. Instead of asking for a password, users received an email with an auto-generated password. This experiment ran on mobile and impact on sales (post-signup) was measured.

In this homepage experiment a number of changes were introduced - with perhaps the most prominent one being the replacement of a video component with customer review badges. Additional copy changes included reinforcement of the latest version number (v11) throughout the page, as well as a dedicated (v11) section in the middle of the page. Impact on demo signups was measured.

In this experiment, an FAQ section was added near the bottom of a long product page. The reviews were collapsed by default, but expandable upon clicking. Impact on adds-to-cart and sales was measured.

In this product detail page experiment, a number of reassurances were brought out visually in a lined or bulleted way. The 4 reassurances included: free shipping and returns; Made in Germany, 90 Day Returns; and Buy With Invoice (popular in Germany). Impact on revenue per user was measured. The control contained very feint copy (smaller and more subtle) about free shipping.

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

In this experiment, standard $ signs and cents were formatted into a smaller superscript. Impact on add-to-cart and sales was measured.

In this product detail page experiment, reassurances under the add-to-cart button were rearranged. The control contained copy about: free shipping and free returns formatted as two gray boxes, with a variety of payment methods and their corresponding logos underneath.

The variation used a more convention bulleted, line-by-line format. It also contained free shipping and returns, but also elaborated with "100 day returns", an "anti-hole guarantee", and "purchase with invoice" (perhaps more popular in Germany?). Impact on sales was measured.

In this experiment, a floating top navigation was shown with a "Join" button. In the control, the navigation was only visible at the top of the page. Also keep in mind that signup starts were also triggered throughout multiple CTAs throughout the page and from particular job detail pages. The a/b test ran on a listing page of Backstage - a casting call job site. Impact on signups  and checkouts was measured.

In this listing page experiment, color sets of the same product were tested against individual products with unique colors (with additional product tiles). Essentially, the A version here contained fewer product items (with color sets), while the B version contained more results and tiles (with grouped products). Impact on total sales was measured.

(The original control and variation was inverted, but was flipped to match the fewer or more results pattern).