Your filter results

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #416 on Designlab.com by Daniel Shapiro   Jun 20, 2022 Desktop Mobile Product

Daniel Shapiro Tested Pattern #105: Lead Magnets In Test #416 On Designlab.com

In this experiment, copy was added which communicated that students signing up for a course would receive extra design resources (the lead magnet). This was added in multiple states of the course page. Impact on lead generation and enrollment was measured.

Test #414 on Volders.de by Frederik Fröhle   May 31, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #98: Auto Suggest In Test #414 On Volders.de

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #413 on by Jakub Linowski   May 26, 2022 Desktop Mobile Shopping Cart

Jakub Linowski Tested Pattern #114: Less Or More Visible Prices In Test #413

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Test #412 on Volders.de by Frederik Fröhle   May 16, 2022 Desktop Mobile Checkout

Frederik Fröhle Tested Pattern #15: Bulleted Reassurances In Test #412 On Volders.de

The Volders experimentation team assumed that adding information about how long it might take to get a cancellation confirmation near a CTA Button would result in higher cancellation requests (the paid service being offered).

The variation contained additional copy translated from German to: "Most of our users receive their cancellation confirmation from <vendor> within 14 days by email or letter."

Test #411 on by Ayat Shukairy   May 09, 2022 Desktop Mobile Product

Ayat Shukairy Tested Pattern #126: Bottom Or Left Thumbnails In Test #411

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Test #410 on Designlab.com by Daniel Shapiro   May 05, 2022 Desktop Mobile Home & Landing

Daniel Shapiro Tested Pattern #29: Surfaced Content In Test #410 On Designlab.com

Does linking to a product detail page help? Or should a homepage simply focus on generic lead generation? In this homepage experiment, the presence of a component with a link to a detailed course landing page was tested. Impact on course enrollments was measured.

Test #408 on by Jakub Linowski   Apr 29, 2022 Desktop Mobile Product

Jakub Linowski Tested Pattern #67: Currency & Taxes In Test #408

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Test #407 on Snocks.com by Melina Hess   Apr 22, 2022 Desktop Mobile Product

Melina Hess Tested Pattern #125: Unit Prices In Test #407 On Snocks.com

Here is an experiment with an added "price per pair" in the context of products with multiple items (packs).A high contrast badge-like copy was appended underneath the price which translates to "only $X per item". Impact on sales was measured.

Test #406 on Chaos.com by Velin Penev   Apr 12, 2022 Desktop Mobile Product

Velin Penev Tested Pattern #112: Lower Price Frames In Test #406 On Chaos.com

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured. 

Test #405 on Learnwithhomer.com by Stanley Zuo   Apr 07, 2022 Mobile Signup

Stanley Zuo Tested Pattern #119: Unselected Or Selected Defaults In Test #405 On Learnwithhomer.com

In this experiment, the annual plan was preselected instead of starting off unselected in the control. Impact on two metrics was measured: any plan and annual plan purchases.

Test #403 on by Jakub Linowski   Mar 29, 2022 Desktop Mobile Checkout

Jakub Linowski Tested Pattern #42: Countdown Timer In Test #403

In this experiment, an urgency related message with a dynamic countdown timer was added on the final checkout screen. Impact on sales was measured.

Test #402 on Snocks.com by Melina Hess   Mar 25, 2022 Mobile Product

Melina Hess Tested Pattern #103: Money Back Guarantee In Test #402 On Snocks.com

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Test #400 on by Herman Klein   Mar 06, 2022 Desktop Shopping Cart

Herman Klein Tested Pattern #65: Add More For Free Shipping In Test #400

In this experiment, customers who were not yet eligible for free shipping (with cart amounts under $39) were presented with an encouraging message to add more and earn free shipping. Impact on progression to checkout and sales was measured.

Test #399 on by Jakub Linowski   Feb 27, 2022 Desktop Mobile Checkout

Jakub Linowski Tested Pattern #35: Floating Labels In Test #399

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).

Test #398 on Adoramapix.com by Herman Klein   Feb 25, 2022 Desktop Shopping Cart

Herman Klein Tested Pattern #121: Free Shipping In Test #398 On Adoramapix.com

In this experiment, customers were eligible for free shipping (with cart amounts of $39 or more) were presented with an earned free shipping message. The variation also showed the value of the earned free shipping - (for example $10). Impact on progression to checkout and sales was measured.

Test #397 on Snocks.com by Melina Hess   Feb 24, 2022 Mobile Product

Melina Hess Tested Pattern #121: Free Shipping In Test #397 On Snocks.com

In this experiment a "Free Shipping & Returns" message was added just below the price information. 

Test #395 on by Jakub Linowski   Jan 31, 2022 Desktop Mobile Product

Jakub Linowski Tested Pattern #52: How It Works In Test #395

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Test #394 on Chaos.com by Velin Penev   Jan 29, 2022 Desktop Product

Velin Penev Tested Pattern #113: More Or Fewer Plans In Test #394 On Chaos.com

In this experiment, a two plan pricing plan (standalone product with a higher collection set) was tested against a single plan one (only a collection set). Impact on clicks and total sales was measured.

Test #5 on Busyteacher.org by Andrei Zakhareuski   Jan 23, 2022 Desktop Mobile Product

Andrei Zakhareuski Tested Pattern #21: What It's Worth In Test #5 On Busyteacher.org

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Test #393 on Snocks.com by Melina Hess   Jan 19, 2022 Mobile Shopping Cart

Melina Hess Tested Pattern #1: Remove Coupon Fields In Test #393 On Snocks.com

This experiment replaced a visible coupon field with a dynamic text link that would initially hide the form field. Only after clicking the text link would the coupon form field appear. The translation from German is "Do you have a coupon code? Click here to apply". Impact on completed transactions was measured.