All Latest 503 A/B Tests

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #415 on Learnwithhomer.com by Stanley Zuo   Jun 09, 2022 Mobile Checkout

Stanley Zuo Tested Pattern #3: Fewer Form Fields In Test #415 On Learnwithhomer.com

Do fewer confirmation form fields matter? In this experiment, redundant password and email confirmation fields were removed during a signup / checkout funnel. Impact on signups was measured.

Test #414 on Volders.de by Frederik Fröhle   May 31, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #98: Auto Suggest In Test #414 On Volders.de

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #413 on by Jakub Linowski   May 26, 2022 Desktop Mobile Shopping Cart

Jakub Linowski Tested Pattern #114: Less Or More Visible Prices In Test #413

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Test #412 on Volders.de by Frederik Fröhle   May 16, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #15: Bulleted Reassurances In Test #412 On Volders.de

The Volders experimentation team assumed that adding information about how long it might take to get a cancellation confirmation near a CTA Button would result in higher cancellation requests (the paid service being offered).

The variation contained additional copy translated from German to: "Most of our users receive their cancellation confirmation from <vendor> within 14 days by email or letter."

Test #411 on by Ayat Shukairy   May 09, 2022 Desktop Mobile Product

Ayat Shukairy Tested Pattern #126: Bottom Or Left Thumbnails In Test #411

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Test #410 on Designlab.com by Daniel Shapiro   May 05, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #29: Surfaced Content In Test #410 On Designlab.com

Does linking to a product detail page help? Or should a homepage simply focus on generic lead generation? In this homepage experiment, the presence of a component with a link to a detailed course landing page was tested. Impact on course enrollments was measured.

Test #409 on Expertinstitute.com by Ardit Veliu   Apr 30, 2022 Desktop Mobile Signup

Ardit Veliu Tested Pattern #20: Canned Response In Test #409 On Expertinstitute.com

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Test #408 on by Jakub Linowski   Apr 29, 2022 Desktop Mobile Product

Jakub Linowski Tested Pattern #67: Currency & Taxes In Test #408

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Test #407 on Snocks.com by Melina Hess   Apr 22, 2022 Desktop Mobile Product

Melina Hess Tested Pattern #125: Unit Prices In Test #407 On Snocks.com

Here is an experiment with an added "price per pair" in the context of products with multiple items (packs).A high contrast badge-like copy was appended underneath the price which translates to "only $X per item". Impact on sales was measured.

Test #406 on Chaos.com by Velin Penev   Apr 12, 2022 Desktop Mobile Product

Velin Penev Tested Pattern #112: Lower Price Frames In Test #406 On Chaos.com

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured. 

Test #405 on Learnwithhomer.com by Stanley Zuo   Apr 07, 2022 Mobile Signup

Stanley Zuo Tested Pattern #119: Unselected Or Selected Defaults In Test #405 On Learnwithhomer.com

In this experiment, the annual plan was preselected instead of starting off unselected in the control. Impact on two metrics was measured: any plan and annual plan purchases.

Test #404 on Expertinstitute.com by Ardit Veliu   Mar 31, 2022 Desktop Mobile Signup

Ardit Veliu Tested Pattern #97: Bigger Form Fields In Test #404 On Expertinstitute.com

In this experiment, the button width was extended to the full width of the form above. Impact on leads was measured.

Test #403 on by Jakub Linowski   Mar 29, 2022 Desktop Mobile Checkout

Jakub Linowski Tested Pattern #42: Countdown Timer In Test #403

In this experiment, an urgency related message with a dynamic countdown timer was added on the final checkout screen. Impact on sales was measured.

Test #402 on Snocks.com by Melina Hess   Mar 25, 2022 Mobile Product

Melina Hess Tested Pattern #103: Money Back Guarantee In Test #402 On Snocks.com

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Test #399 on by Jakub Linowski   Feb 27, 2022 Desktop Mobile Checkout

Jakub Linowski Tested Pattern #35: Floating Labels In Test #399

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).

Test #397 on Snocks.com by Melina Hess   Feb 24, 2022 Mobile Product

Melina Hess Tested Pattern #121: Free Shipping In Test #397 On Snocks.com

In this experiment a "Free Shipping & Returns" message was added just below the price information. 

Test #123 on Getninjas.com.br by Rodolfo Lugli   Feb 11, 2022 Mobile Thank You

Rodolfo Lugli Tested Pattern #71: Personalized Next Step In Test #123 On Getninjas.com.br

In this experiment, two app download buttons were tested against a single OS personalized one. In the control, both branded App Store and Google Play buttons were shown statically. Whereas in the variation a single download (stylized consistently with site wide button styles) button was shown depending on the user's operating system. Impact on application download was measured.

Test #395 on by Jakub Linowski   Jan 31, 2022 Desktop Mobile Product

Jakub Linowski Tested Pattern #52: How It Works In Test #395

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Test #5 on Busyteacher.org by Andrei Zakhareuski   Jan 23, 2022 Desktop Mobile Product

Andrei Zakhareuski Tested Pattern #21: What It's Worth In Test #5 On Busyteacher.org

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Test #122 on Designlab.com by Daniel Shapiro   Jan 22, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #30: Authentic Photos In Test #122 On Designlab.com

In this experiment for an online design course, the variation had an extra section with student work previews. The previews were not clickable but were added just below the fold. Impact on leads was measured by potential students requesting a syllabus through an online form throughout the long landing page.