All Latest 620 A/B Tests

Test #429 on Snocks.com by Melina HessMelina Hess Aug 16, 2022 Mobile Desktop Product X.X% Sales

Melina Tested Pattern #121: Free Shipping On Snocks.com

 - Variant A
 - Variant B

Upon clicking the Add-To-Cart button, the button label changed to a cheering message which congratulated the user on his choice and ensuring that shipping is free. Translation: "Good choice. Your shipping and returns are free."

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #427 on Designlab.com by Daniel ShapiroDaniel Shapiro Aug 10, 2022 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #28: Easiest Fields First On Designlab.com

 - Variant A
 - Variant B

In this experiment, the course enrollment start date was moved from step 2 to step 1 of an enrollment / checkout flow. The test was run by Designlab - that offers design courses and education with a strong element of mentorship. Impact on progression to next step and completed transactions were measured.

Test #426 on Phorest.com by Sorcha MullisSorcha Mullis Aug 09, 2022 Desktop Mobile Home & Landing X.X% Leads

Sorcha Tested Pattern #9: Multiple Steps On Phorest.com

 - Variant A
 - Variant B

In this experiment, a single step popup modal was tested against a 4 step sign up funnel. Users entered the experiment on the homepage and the behavior of the two buttons, book a demo and get a quote, was adjusted. Impact on leads was measured.

Test #425 on by Jakub LinowskiJakub Linowski Aug 03, 2022 Desktop Product X.X% Sales

Jakub Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, the complete buy box on a product detail page, floated along as users scrolled through the long screen. The variation made sure the product choice and order now button was always visible. Impact on adds-to-cart and sales was measured.

Test #421 on Amazon.com by Marika FranciscoMarika Francisco Jul 15, 2022 Desktop Mobile Product X.X% Sales

Marika Tested Pattern #43: Long Titles On Amazon.com

 - Variant A
 - Variant B

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Test #420 on Designlab.com by Daniel ShapiroDaniel Shapiro Jul 12, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #115: Pricing Comparison Table On Designlab.com

 - Variant A
 - Variant B

In this experiment, pricing plans were laid out horizontally for easier comparison. In the variation, most of the plan benefits, features and differences were also referenced using a single lable that was left-aligned. The idea was to make the variables aligned and therefore more comparable.

This pricing table appeared at the bottom of a long design program landing page. Impact on leads and applications was measured.

Test #417 on Cxl.com by Ognjen BoškovićOgnjen Bošković Jun 27, 2022 Desktop Mobile Signup X.X% Signups

Ognjen Tested Pattern #127: Vague Or Specific Benefits On Cxl.com

 - Variant A
 - Variant B

CXL ran an interesting experiment that (1) added more specificity on a newsletter subscription page as well as (2) reinforced it consistently. Most visibly, an abstract or vague headline statement (control) was changed to a benefit oriented one - hinting that subscribers will eventually receive valuable case studies. This message was further reinforced with supporting copy that explained where these case studies are obtained from along with the frequency of the delivery. This same message was also reinforced with an image of actual case studies. The call to action button was also adjusted to mimic the benefit.

Impact on newsletter signups was measured.

Test #414 on Volders.de by Frederik FröhleFrederik Fröhle May 31, 2022 Desktop Mobile Checkout X.X% Sales

Frederik Tested Pattern #98: Auto Suggest On Volders.de

 - Variant A
 - Variant B

Does adding Google's address auto complete functionality to an address field help with higher form completions? This auto fill feature has been tested in the variation of a contract cancellation funnel. After selecting an auto completed address from a pulldown menu, the following fields were preselected: house number, zip code, city and country (potentially lowering friction?). Impact on successful form completions (contract cancellations) has been measured. Notice how the form also expanded progressively upon selecting the complete address in the variation.  

Test #411 on by Ayat ShukairyAyat Shukairy May 09, 2022 Desktop Mobile Product X.X% Sales

Ayat Tested Pattern #126: Bottom Or Left Thumbnails

 - Variant A
 - Variant B

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Test #409 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 30, 2022 Desktop Mobile Signup X.X% Leads

Ardit Tested Pattern #20: Canned Response On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Test #406 on Chaos.com by Velin PenevVelin Penev Apr 12, 2022 Desktop Mobile Product X.X% Sales

Velin Tested Pattern #112: Lower Price Frames On Chaos.com

 - Variant A
 - Variant B

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured. 

Test #405 on Learnwithhomer.com by Stanley ZuoStanley Zuo Apr 07, 2022 Mobile Signup X.X% Sales

Stanley Tested Pattern #119: Unselected Or Selected Defaults On Learnwithhomer.com

 - Variant A
 - Variant B

In this experiment, the annual plan was preselected instead of starting off unselected in the control. Impact on two metrics was measured: any plan and annual plan purchases.

Test #404 on Expertinstitute.com by Ardit VeliuArdit Veliu Mar 31, 2022 Desktop Mobile Signup X.X% Leads

Ardit Tested Pattern #97: Bigger Form Fields On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, the button width was extended to the full width of the form above. Impact on leads was measured.

Test #402 on Snocks.com by Melina HessMelina Hess Mar 25, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #103: Money Back Guarantee On Snocks.com

 - Variant A
 - Variant B

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Test #401 on Learnwithhomer.com by Stanley ZuoStanley Zuo Mar 11, 2022 Desktop Home & Landing X.X% Signups

Stanley Tested Pattern #58: Full Height False Bottom On Learnwithhomer.com

 - Variant A
 - Variant B

Here the experiment contained a layout change. Standard content components with varied heights were tested against sections with false bottoms. That is the conntent blocks in the variation took up 100% height of the viewport. This change was also applied throughout the rest of the content blocks. Impact on overall signup rates was measured.

Test #399 on by Jakub LinowskiJakub Linowski Feb 27, 2022 Desktop Mobile Checkout X.X% Progression

Jakub Tested Pattern #35: Floating Labels

 - Variant A
 - Variant B

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).

Test #396 on Depositphotos.com by Gleb HodorovskiyGleb Hodorovskiy Feb 13, 2022 Desktop Listing X.X% Revenue

Gleb Tested Pattern #124: Confirmed Selection On Depositphotos.com

 - Variant A
 - Variant B

In this experiment from Conversionrate.store, the framing of the registration message was changed from a generic account creation one to a specific image selected by the user. The experiment started on a listing page of a stock photography / illustration site. The control showed a more generic message with benefits for signing up and making the purchase. Whereas the variation repeated the actual image that customers clicked on from listing pages - establishing continuity as well as providing a reason for signing up. Impact on sales was measured.

Test #123 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Feb 11, 2022 Mobile Thank You X.X% Engagement

Rodolfo Tested Pattern #71: Personalized Next Step On Getninjas.com.br

 - Variant A
 - Variant B

In this experiment, two app download buttons were tested against a single OS personalized one. In the control, both branded App Store and Google Play buttons were shown statically. Whereas in the variation a single download (stylized consistently with site wide button styles) button was shown depending on the user's operating system. Impact on application download was measured.

Test #394 on Chaos.com by Velin PenevVelin Penev Jan 29, 2022 Desktop Product X.X% Sales

Velin Tested Pattern #113: More Or Fewer Plans On Chaos.com

 - Variant A
 - Variant B

In this experiment, a two plan pricing plan (standalone product with a higher collection set) was tested against a single plan one (only a collection set). Impact on clicks and total sales was measured.

Test #393 on Snocks.com by Melina HessMelina Hess Jan 19, 2022 Mobile Shopping Cart X.X% Sales

Melina Tested Pattern #1: Remove Coupon Fields On Snocks.com

 - Variant A
 - Variant B

This experiment replaced a visible coupon field with a dynamic text link that would initially hide the form field. Only after clicking the text link would the coupon form field appear. The translation from German is "Do you have a coupon code? Click here to apply". Impact on completed transactions was measured.