Your filter results

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #456 on Aboalarm.de by Daria Kurchinskaia   Feb 23, 2023 Desktop Mobile Signup

Daria Kurchinskaia Tested Pattern #28: Easiest Fields First In Test #456 On Aboalarm.de

In this experiment, a more difficult step of a contract cancelation service flow was rearranged toward a later step. In the variation, the easier step (hypothetically) with personal details and address fields was placed as the first step. Whereas the step with contract or account numbers (hypothetically more difficult) were placed as the second step.

Test #440 on Formelskin.de by Alexander Krieger   Nov 17, 2022 Mobile Signup

Alexander Krieger Tested Pattern #49: Above The Fold Call To Action In Test #440 On Formelskin.de

In this experiment, the call to action or button was raised above the legal text to be visible right away without scrolling. Additionally a error message was added for users that did not activate the checkbox to remind them that this is mandatory. Impact on signups and eventual follow-through to purchases (3 steps later) was measured.

Test #439 on Designlab.com by Daniel Shapiro   Oct 31, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #18: Single Or Alternative Buttons In Test #439 On Designlab.com

This was a larger leap experiment with numerous changes to the header part of a design program landing page. One of the key changes however was a shift from a single to multiple call to actions for lead generation. In the control, all potential leads would first funnel through a single syllabus download flow. In the variation, users were given three visible choices: download syllabus, webinar signup and/or book a live call with admissions. Impact on overall generated leads was measured, as well as paid enrollments.

Test #435 on Volders.de by Daria Kurchinskaia   Oct 17, 2022 Desktop Mobile Checkout

Daria Kurchinskaia Tested Pattern #9: Multiple Steps In Test #435 On Volders.de

In this experiment, a question about a customer's reason for purchase was broken out into a separate step and moved earlier in the process. In the control, this question was asked in the final checkout step along with a plan selection (Step 4 of 4). In the variation, this question was shifted as a standalone first step (Step 1 of 5). Impact on completed purchases was measured (for a contract cancellation service in this case).

Test #429 on Snocks.com by Melina Hess   Aug 16, 2022 Mobile Desktop Product

Melina Hess Tested Pattern #121: Free Shipping In Test #429 On Snocks.com

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Test #427 on Designlab.com by Daniel Shapiro   Aug 10, 2022 Desktop Mobile Checkout

Daniel Shapiro Tested Pattern #28: Easiest Fields First In Test #427 On Designlab.com

In this experiment, the course enrollment start date was moved from step 2 to step 1 of an enrollment / checkout flow. The test was run by Designlab - that offers design courses and education with a strong element of mentorship. Impact on progression to next step and completed transactions were measured.

Test #426 on Phorest.com by Sorcha Mullis   Aug 09, 2022 Desktop Mobile Home & Landing

Sorcha Mullis Tested Pattern #9: Multiple Steps In Test #426 On Phorest.com

In this experiment, a single step popup modal was tested against a 4 step sign up funnel. Users entered the experiment on the homepage and the behavior of the two buttons, book a demo and get a quote, was adjusted. Impact on leads was measured.

Test #425 on by Jakub Linowski   Aug 03, 2022 Desktop Product

Jakub Linowski Tested Pattern #41: Sticky Call To Action In Test #425

In this experiment, the complete buy box on a product detail page, floated along as users scrolled through the long screen. The variation made sure the product choice and order now button was always visible. Impact on adds-to-cart and sales was measured.

Test #421 on Amazon.com by Marika Francisco   Jul 15, 2022 Desktop Mobile Product

Marika Francisco Tested Pattern #43: Long Titles In Test #421 On Amazon.com

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Test #420 on Designlab.com by Daniel Shapiro   Jul 12, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #115: Pricing Comparison Table In Test #420 On Designlab.com

In this experiment, pricing plans were laid out horizontally for easier comparison. In the variation, most of the plan benefits, features and differences were also referenced using a single lable that was left-aligned. The idea was to make the variables aligned and therefore more comparable.

This pricing table appeared at the bottom of a long design program landing page. Impact on leads and applications was measured.

Test #417 on Cxl.com by Ognjen Bošković   Jun 27, 2022 Desktop Mobile Signup

Ognjen Bošković Tested Pattern #127: Vague Or Specific Benefits In Test #417 On Cxl.com

CXL ran an interesting experiment that (1) added more specificity on a newsletter subscription page as well as (2) reinforced it consistently. Most visibly, an abstract or vague headline statement (control) was changed to a benefit oriented one - hinting that subscribers will eventually receive valuable case studies. This message was further reinforced with supporting copy that explained where these case studies are obtained from along with the frequency of the delivery. This same message was also reinforced with an image of actual case studies. The call to action button was also adjusted to mimic the benefit.

Impact on newsletter signups was measured.

Test #414 on Volders.de by Frederik Fröhle   May 31, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #98: Auto Suggest In Test #414 On Volders.de

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #411 on by Ayat Shukairy   May 09, 2022 Desktop Mobile Product

Ayat Shukairy Tested Pattern #126: Bottom Or Left Thumbnails In Test #411

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Test #409 on Expertinstitute.com by Ardit Veliu   Apr 30, 2022 Desktop Mobile Signup

Ardit Veliu Tested Pattern #20: Canned Response In Test #409 On Expertinstitute.com

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Test #406 on Chaos.com by Velin Penev   Apr 12, 2022 Desktop Mobile Product

Velin Penev Tested Pattern #112: Lower Price Frames In Test #406 On Chaos.com

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured. 

Test #405 on Learnwithhomer.com by Stanley Zuo   Apr 07, 2022 Mobile Signup

Stanley Zuo Tested Pattern #119: Unselected Or Selected Defaults In Test #405 On Learnwithhomer.com

In this experiment, the annual plan was preselected instead of starting off unselected in the control. Impact on two metrics was measured: any plan and annual plan purchases.

Test #404 on Expertinstitute.com by Ardit Veliu   Mar 31, 2022 Desktop Mobile Signup

Ardit Veliu Tested Pattern #97: Bigger Form Fields In Test #404 On Expertinstitute.com

In this experiment, the button width was extended to the full width of the form above. Impact on leads was measured.

Test #402 on Snocks.com by Melina Hess   Mar 25, 2022 Mobile Product

Melina Hess Tested Pattern #103: Money Back Guarantee In Test #402 On Snocks.com

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Test #401 on Learnwithhomer.com by Stanley Zuo   Mar 11, 2022 Desktop Home & Landing

Stanley Zuo Tested Pattern #58: Full Height False Bottom In Test #401 On Learnwithhomer.com

Here the experiment contained a layout change. Standard content components with varied heights were tested against sections with false bottoms. That is the conntent blocks in the variation took up 100% height of the viewport. This change was also applied throughout the rest of the content blocks. Impact on overall signup rates was measured.

Test #399 on by Jakub Linowski   Feb 27, 2022 Desktop Mobile Checkout

Jakub Linowski Tested Pattern #35: Floating Labels In Test #399

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).