All Latest 644 A/B Tests

MOST RECENT TESTS

Test #406 on Chaos.com by Velin PenevVelin Penev Apr 12, 2022 Desktop Mobile Product X.X% Sales

Velin Tested Pattern #112: Lower Price Frames On Chaos.com

Pattern #112: Lower Price Frames - Variant A
Pattern #112: Lower Price Frames - Variant B

In this experiment, the pricing of three software plans was consistently framed into a more comparable monthly context. Whereas the control version only showed the total prices for each plan, the variation showed both the total and monthly prices. Impact on sales was measured. 

Total Sample: 69,080 • Statistical Power at 5% MDE: 8.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #402 on Snocks.com by Melina HessMelina Hess Mar 25, 2022 Mobile Product X.X% Sales

Melina Tested Pattern #103: Money Back Guarantee On Snocks.com

Pattern #103: Money Back Guarantee - Variant A
Pattern #103: Money Back Guarantee - Variant B

In this experiment on a product screen, a message about quality (from the founders) was reformatted to reinforce the "Anti Hole Guarantee" (in the context of socks). The founders were also made more prominent and their signature added as well. Interestingly, the actual guarantee copy (and its important detail about a 6 month product replacement) was present further down on both the control and variation.

The translation of the new copy (Google Translate) reads:

Since we founded SNOCKS, the quality and comfort of our products have always been our top priority. Why? When we both were still studying, we didn't have the money to buy new socks & underpants every 1-2 months. That's why it was clear to us from the start that we wanted to sell quality products that are also extremely comfortable. And just in case something goes wrong, we have decided to introduce an anti-hole guarantee.

Total Sample: 456,229 • Statistical Power at 5% MDE: 99.1%

Test #397 on Snocks.com by Melina HessMelina Hess Feb 24, 2022 Mobile Product X.X% Revenue

Melina Tested Pattern #121: Free Shipping On Snocks.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this experiment a "Free Shipping & Returns" message was added just below the price information. 

Test #395 by Jakub LinowskiJakub Linowski Jan 31, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #52: How It Works

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Total Sample: 17,099 • Statistical Power at 5% MDE: 15.8%

Test #394 on Chaos.com by Velin PenevVelin Penev Jan 29, 2022 Desktop Product X.X% Sales

Velin Tested Pattern #113: More Or Fewer Plans On Chaos.com

Pattern #113: More Or Fewer Plans - Variant A
Pattern #113: More Or Fewer Plans - Variant B

In this experiment, a two plan pricing plan (standalone product with a higher collection set) was tested against a single plan one (only a collection set). Impact on clicks and total sales was measured.

Total Sample: 23,261 • Statistical Power at 5% MDE: 4.8%

Test #5 on Busyteacher.org by Andrei ZakhareuskiAndrei Zakhareuski Jan 23, 2022 Desktop Mobile Product X.X% Sales

Andrei Tested Pattern #21: What It's Worth On Busyteacher.org

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Total Sample: 4,895 • Statistical Power at 5% MDE: 4%

Test #122 on Designlab.com by Daniel ShapiroDaniel Shapiro Jan 22, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #30: Authentic Photos On Designlab.com

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B

In this experiment for an online design course, the variation had an extra section with student work previews. The previews were not clickable but were added just below the fold. Impact on leads was measured by potential students requesting a syllabus through an online form throughout the long landing page.

Total Sample: 9,862 • Statistical Power at 5% MDE: 7.4%

Test #392 by Jakub LinowskiJakub Linowski Dec 31, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #122: Zigzag Layout

Pattern #122: Zigzag Layout - Variant A
Pattern #122: Zigzag Layout - Variant B

In this experiment, paragraph style copy was reorganized into a zig zag layout with key sections being reinforiced with copy-as-image statements. Impact on adds-to-cart and sales was measured.

Total Sample: 41,827 • Statistical Power at 5% MDE: 28.5%

Test #385 on Snocks.com by Samuel HessSamuel Hess Nov 25, 2021 Mobile Product X.X% Sales

Samuel Tested Pattern #63: Trust Seals On Snocks.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B

In this experiment, a simple Amazon badge was added on a product page. The translated (Google) language read: "Since we founded snocks, our customers have always been our focus - we are constantly trying to develop further. That's why we're extremely proud that Amazon attracted attention and that they named us Sales Partner of the Year in 2019."

Total Sample: 351,255 • Statistical Power at 5% MDE: 99.9%

Test #382 on Snocks.com by Samuel HessSamuel Hess Oct 31, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this experiment, the variation contained a simple text change that described the quality of the product. According to Google Translate the text changed from "tight men's underpants" (control) to "are so comfortable that you don't feel them when you wear them" (variation).

Total Sample: 140,756 • Statistical Power at 5% MDE: 86.3%

Test #378 by Jakub LinowskiJakub Linowski Oct 07, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

Pattern #119: Unselected Or Selected Defaults - Variant A
Pattern #119: Unselected Or Selected Defaults - Variant B

Here we have an experiment with a variation that preselected an option for a club duration. The control required customers to first express the choice for how many months they would like to order a product for. Whereas the variation defaulted to 12 months from the beginning.

Impact on adds-to-cart and sales was measured. The experiment unfortunately had to be stopped early due to another embedded variation that was performing poorly. And so it does not have many transactions.

Total Sample: 2,953 • Statistical Power at 5% MDE: 5.2%

Test #376 on Snocks.com by Samuel HessSamuel Hess Sep 29, 2021 Mobile Desktop Product X.X% Sales

Samuel Tested Pattern #15: Bulleted Reassurances On Snocks.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

Total Sample: 136,126 • Statistical Power at 5% MDE: 79.6%

Test #372 on Fluke.com by Marika FranciscoMarika Francisco Aug 30, 2021 Desktop Product X.X% Sales

Marika Tested Pattern #122: Zigzag Layout On Fluke.com

Pattern #122: Zigzag Layout - Variant A
Pattern #122: Zigzag Layout - Variant B

In this experiment, product descriptions were changed to an alternating zig zag layout with images. Impact on adds-to-cart and sales was measured.

Total Sample: 18,325 • Statistical Power at 5% MDE: 3.2%

Test #366 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.

Total Sample: 80,881 • Statistical Power at 5% MDE: 95%

Test #365 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 13, 2021 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Mvideo.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, reviews on product pages were exposed completely. Instead of hiding them under a clickable tab, they were shown by default in the variation. Impact on sales was measured.

Total Sample: 78,120 • Statistical Power at 5% MDE: 16.1%

Test #364 on Lotuscrafts.eu by Samuel HessSamuel Hess Jul 06, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Lotuscrafts.eu

Pattern #122: Zigzag Layout - Variant A
Pattern #122: Zigzag Layout - Variant B

In this experiment, product descriptions or qualities were added using a zigzag layout pattern composed of photos and extra copy. This sections was appended between existing copy and testimonials. Some of the copy highlights included wording such as "innovative surface", "non-slip and wide", and "skin-friendly". Impact on adds-to-cart and sales was measured.

Total Sample: 32,392 • Statistical Power at 5% MDE: 29.1%

Test #363 by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 • Statistical Power at 5% MDE: 33.9%

Test #362 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Jun 23, 2021 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #7: Social Counts On Vivareal.com.br

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, the number of recent property views was displayed under the call to action. Impact on overall lead generation was measured. (Translated using Google from Brazilian Portuguese.)

Total Sample: 7,087,369 • Statistical Power at 5% MDE: 99.9%

Test #361 on Chaosgroup.com by Velin PenevVelin Penev Jun 22, 2021 Desktop Product X.X% Sales

Velin Tested Pattern #49: Above The Fold Call To Action On Chaosgroup.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

In this experiment, a pricing plan selector was shifted from the very bottom of a long product page towards (almost) the top. Impact on any transactions or sales was measured.

Total Sample: 49,030 • Statistical Power at 5% MDE: 6.5%

Test #360 by Jakub LinowskiJakub Linowski Jun 16, 2021 Desktop Product X.X% Sales

Jakub Tested Pattern #60: Repeated Bottom Call To Action

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a comparison chart with various purchasing options was appended at the bottom of a product page. 

Total Sample: 32,070 • Statistical Power at 5% MDE: 35.1%