All Latest 610 A/B Tests

This experiment started right after users of a trading app received trade order expiry notification (for a security trading app). In the control, after clicking the notifications, users would have to navigate to the trade themselves. In the variation, 1) an additional step was added which informed what happened (an order was not place and expired) and 2) they were automatically send to the order page. Impact on orders placed was measured.

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.

In this experiment, the presence of a search bar was tested against no search bar altogether. The control had search, and in the variation it was removed. The variation also exposed items from within the "Need Help?" menu, making "My account", "Contact Us" and "FAQ" more prominent.

(Here the AB test is inverted / flipped to match the pattern). 

In this experiment, a higher contrast search bar with a blue border and a filled blue button style was tested against a more feint style.  Impact on searches and purchases was measured. (A/B test was inverted to B/A in order to fit the filled-vs-ghost button pattern).

In this experiment, an offers page was shifted all the way down inside an expanded mobile navigation. The control showed it at the very top. The variation showed it at the bottom. (Note that  the screen shot shows an already scrolled navigation - in the initial view, users would not be able to see the discount page right away, as it required some scrolling). Impact on overall sales was measured.

In this experiment, search functionality was added in the variation, globally on mobile. Impact on sales was measured

In this experiment, single column (longer) form fields were tested against a two column layout (more compact).

In this experiment, a simple "Join Now" button was added inside an expanded mobile navigation menu. Clicking the button would start a multiple step membership subscription process. Impact on subscription starts and final sales were tracked.

This experiment measured the impact of adding text labels to three icon-only nav items. 

In this experiment, a set of reassurances and reviews were added in the header of this ecommerce website. Translating from German, these read: "Anti Hole Guarantee", "Free Shipping" and "X Ratings out of Y Reviews".

In this experiment variation, the saved suppliers feature was surfaced in the global navigation.It was already possible to save supplier companies from listing and specific company pages. This experiment aimed to increase the saving functions visibility and possibly increase more leads. 

In this experiment, registered trial users were shown a 65 minute counter on multiple pages (dashboard, listing, quiz, articles) encouraging them to get a full subscription and study all content. Both A and B experiences offered the same limited content for trial users. After the 65 minutes came to an end, the B variation showed an additional "Go Premium" button on all pages, but continued to offer the same limited content.

In this experiment users saw a sticky bar advertising the benefits of a Premium account across the bottom of the website, wherever they navigate. The sticky call to action appeared with a 4 second delay and was floating.

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

In the variation, the "Help" section was reworded to "How to study".

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.