Your filter results

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #439 on Designlab.com by Daniel Shapiro   Oct 31, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #18: Single Or Alternative Buttons In Test #439 On Designlab.com

This was a larger leap experiment with numerous changes to the header part of a design program landing page. One of the key changes however was a shift from a single to multiple call to actions for lead generation. In the control, all potential leads would first funnel through a single syllabus download flow. In the variation, users were given three visible choices: download syllabus, webinar signup and/or book a live call with admissions. Impact on overall generated leads was measured, as well as paid enrollments.

Test #436 on Designlab.com by Daniel Shapiro   Oct 25, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #7: Social Counts In Test #436 On Designlab.com

In this experiment, social proof and scarcity messages were shown on a course enrollment landing page. When students were starting to sign up at the beginning of each month (with greater availability), a simpler "X students have already enrolled in the next cohort" message was used.

Later in the month when fewer spots were available, a more scarce message was used with the following copy "ONLY X SPOTS available in the next cohort".

In both cases, the numbers were accurate and dynamically updated.

Test #435 on Volders.de by Daria Kurchinskaia   Oct 17, 2022 Desktop Mobile Checkout

Daria Kurchinskaia Tested Pattern #9: Multiple Steps In Test #435 On Volders.de

In this experiment, a question about a customer's reason for purchase was broken out into a separate step and moved earlier in the process. In the control, this question was asked in the final checkout step along with a plan selection (Step 4 of 4). In the variation, this question was shifted as a standalone first step (Step 1 of 5). Impact on completed purchases was measured (for a contract cancellation service in this case).

Test #432 on Snocks.com by Melina Hess   Sep 29, 2022 Mobile Global

Melina Hess Tested Pattern #94: Visible Search In Test #432 On Snocks.com

In this experiment, search functionality was added in the variation, globally on mobile. Impact on sales was measured

Test #431 on Volders.de by Daria Kurchinskaia   Sep 23, 2022 Desktop Mobile Pricing

Daria Kurchinskaia Tested Pattern #21: What It's Worth In Test #431 On Volders.de

In this experiment, a historically higher price point was added as a crossed out anchor. The control only showed the current price. The variation showed the current price with the higher price crossed out. Impact on sales was measured.

Test #430 on by Jakub Linowski   Sep 20, 2022 Desktop Product

Jakub Linowski Tested Pattern #26: Cart Reminder And Recently Viewed In Test #430

In this experiment, up to 5 recently viewed product pages would appear on the left hand navigation. The idea was to make it easier for users get back to what they were looking at in case they were browsing. These recently viewed products were not visibile in the control. Impact on adds-to-cart and completed transactions was measured.

Test #428 on Volders.de by Daria Kurchinskaia   Aug 16, 2022 Desktop Mobile Signup

Daria Kurchinskaia Tested Pattern #26: Cart Reminder And Recently Viewed In Test #428 On Volders.de

In this test 1) a passive hint communicated to users that their data will be saved for 7 days for them to be able to continue their cancellation later and 2) dropped off users were targeted with an email campaign within the first 4 hours after drop off. The reminder email linked users to a shipping page (checkout page) without them requiring to fill out their personal, contract information one more time. 

Test #429 on Snocks.com by Melina Hess   Aug 16, 2022 Mobile Desktop Product

Melina Hess Tested Pattern #121: Free Shipping In Test #429 On Snocks.com

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Test #427 on Designlab.com by Daniel Shapiro   Aug 10, 2022 Desktop Mobile Checkout

Daniel Shapiro Tested Pattern #28: Easiest Fields First In Test #427 On Designlab.com

In this experiment, the course enrollment start date was moved from step 2 to step 1 of an enrollment / checkout flow. The test was run by Designlab - that offers design courses and education with a strong element of mentorship. Impact on progression to next step and completed transactions were measured.

Test #425 on by Jakub Linowski   Aug 03, 2022 Desktop Product

Jakub Linowski Tested Pattern #41: Sticky Call To Action In Test #425

In this experiment, the complete buy box on a product detail page, floated along as users scrolled through the long screen. The variation made sure the product choice and order now button was always visible. Impact on adds-to-cart and sales was measured.

Test #424 on by Sandis Viksna   Jul 28, 2022 Desktop Shopping Cart

Sandis Viksna Tested Pattern #45: Benefit Bar In Test #424

In this experiment, 3 reassurances were shown at the bottom of cart and checkout pages. The web site was selling health and nutrition products for males and one of the reassurances included "discreet shipping". Impact on sales was measured.

Test #422 on Volders.de by Daria Kurchinskaia   Jul 22, 2022 Desktop Mobile Shopping Cart

Daria Kurchinskaia Tested Pattern #3: Fewer Form Fields In Test #422 On Volders.de

A birthdate field was removed during a signup process for a paid contract cancellation service. Impact on progression (next step) and sales (completed transactions) was measured.

Test #421 on Amazon.com by Marika Francisco   Jul 15, 2022 Desktop Mobile Product

Marika Francisco Tested Pattern #43: Long Titles In Test #421 On Amazon.com

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Test #419 on by Jakub Linowski   Jun 29, 2022 Desktop Home & Landing

Jakub Linowski Tested Pattern #68: Welcome Discount In Test #419

In this experiment, the presence of a discount modal (bigger discount for larger purchases) was tested on home and product pages. The trigger happend after a scroll down, a few second pause, and a mouse scroll up interaction. Impact on sales was measured.

Test #418 on Online.metro-cc.ru by Andrey Andreev   Jun 28, 2022 Desktop Mobile Home & Landing

Andrey Andreev Tested Pattern #79: Single Or Multiple Triggers In Test #418 On Online.metro-cc.ru

In this experiment, popular product category links were added near the bottom of the homepage of an online grocery store - Metro. Impact on completed sales was measured.

Test #416 on Designlab.com by Daniel Shapiro   Jun 20, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #105: Lead Magnets In Test #416 On Designlab.com

In this experiment, copy was added which communicated that students signing up for a course would receive extra design resources (the lead magnet). This was added in multiple states of the course page. Impact on lead generation and enrollment was measured.

Test #414 on Volders.de by Frederik Fröhle   May 31, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #98: Auto Suggest In Test #414 On Volders.de

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #413 on by Jakub Linowski   May 26, 2022 Desktop Mobile Shopping Cart

Jakub Linowski Tested Pattern #114: Less Or More Visible Prices In Test #413

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Test #412 on Volders.de by Frederik Fröhle   May 16, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #15: Bulleted Reassurances In Test #412 On Volders.de

The Volders experimentation team assumed that adding information about how long it might take to get a cancellation confirmation near a CTA Button would result in higher cancellation requests (the paid service being offered).

The variation contained additional copy translated from German to: "Most of our users receive their cancellation confirmation from <vendor> within 14 days by email or letter."

Test #411 on by Ayat Shukairy   May 09, 2022 Desktop Mobile Product

Ayat Shukairy Tested Pattern #126: Bottom Or Left Thumbnails In Test #411

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.