All Latest 633 A/B Tests

MOST RECENT TESTS

Test #395 on by Jakub LinowskiJakub Linowski Jan 31, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #52: How It Works

 - Variant A
 - Variant B

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Total Sample: 17,099 Statistical Power at 5% MDE: 15.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #394 on Chaos.com by Velin PenevVelin Penev Jan 29, 2022 Desktop Product X.X% Sales

Velin Tested Pattern #113: More Or Fewer Plans On Chaos.com

 - Variant A
 - Variant B

In this experiment, a two plan pricing plan (standalone product with a higher collection set) was tested against a single plan one (only a collection set). Impact on clicks and total sales was measured.

Total Sample: 23,261 Statistical Power at 5% MDE: 4.8%

Test #5 on Busyteacher.org by Andrei ZakhareuskiAndrei Zakhareuski Jan 23, 2022 Desktop Mobile Product X.X% Sales

Andrei Tested Pattern #21: What It's Worth On Busyteacher.org

 - Variant A
 - Variant B

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Total Sample: 4,895 Statistical Power at 5% MDE: 4%

Test #122 on Designlab.com by Daniel ShapiroDaniel Shapiro Jan 22, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #30: Authentic Photos On Designlab.com

 - Variant A
 - Variant B

In this experiment for an online design course, the variation had an extra section with student work previews. The previews were not clickable but were added just below the fold. Impact on leads was measured by potential students requesting a syllabus through an online form throughout the long landing page.

Total Sample: 9,862 Statistical Power at 5% MDE: 7.4%

Test #392 on by Jakub LinowskiJakub Linowski Dec 31, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #122: Zigzag Layout

 - Variant A
 - Variant B

In this experiment, paragraph style copy was reorganized into a zig zag layout with key sections being reinforiced with copy-as-image statements. Impact on adds-to-cart and sales was measured.

Total Sample: 41,827 Statistical Power at 5% MDE: 28.5%

Test #391 on Backstage.com by Stanley ZuoStanley Zuo Dec 30, 2021 Desktop Mobile Listing X.X% Signups

Stanley Tested Pattern #82: Onboarding Callouts On Backstage.com

 - Variant A
 - Variant B

This experiment added a small nudge or callout to encourage more signups. Attention was directed towards the save function, which lead to the signup flow for anyone not signed it. Impact on signups was measured.

Total Sample: 159,569 Statistical Power at 5% MDE: 99.5%

Test #390 on Snocks.com by Melina HessMelina Hess Dec 21, 2021 Desktop Mobile Checkout X.X% Sales

Melina Tested Pattern #106: Back Buttons On Snocks.com

 - Variant A
 - Variant B

In this experiment, the variation has a "Back To Shopping Cart" link right underneath the checkout button. Impact on sales was measured.

Total Sample: 22,852 Statistical Power at 5% MDE: 97.5%

Test #389 on Svsound.com by Keenan DavisKeenan Davis Dec 16, 2021 Desktop Mobile Checkout X.X% Sales

Keenan Tested Pattern #1: Remove Coupon Fields On Svsound.com

 - Variant A
 - Variant B

In this simple experiment, a highly visible coupon field was replaced with a less visible (but clickable) link in the variation. Clicking on the link would show the coupon field. Impact on sales and revenue was measured.

Total Sample: 20,321 Statistical Power at 5% MDE: 37.2%

Test #386 on Learnwithhomer.com by Stanley ZuoStanley Zuo Nov 29, 2021 Desktop Pricing X.X% Sales

Stanley Tested Pattern #112: Lower Price Frames On Learnwithhomer.com

 - Variant A
 - Variant B

In this experiment, the annual plan was standardized and framed in a monthly price context (during the iOS signup flow). This made the annual plan more comparable to the monthly plan price. Impact on overall sales and annual plan sales was measured.

Total Sample: 11,351 Statistical Power at 5% MDE: 19%

Test #383 on by Jakub LinowskiJakub Linowski Nov 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #123: Single Or Double Column Form Fields

 - Variant A
 - Variant B

In this simple [inverted] experiment, the variation organized the form fields into a single column. The control had two columns of form fields.

Total Sample: 2,143 Statistical Power at 5% MDE: 23.3%

Test #382 on Snocks.com by Samuel HessSamuel Hess Oct 31, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

 - Variant A
 - Variant B

In this experiment, the variation contained a simple text change that described the quality of the product. According to Google Translate the text changed from "tight men's underpants" (control) to "are so comfortable that you don't feel them when you wear them" (variation).

Total Sample: 140,756 Statistical Power at 5% MDE: 86.3%

Test #381 on Expertinstitute.com by Ardit VeliuArdit Veliu Oct 30, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #49: Above The Fold Call To Action On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, an extra button to a signup lead form was placed above the fold. In the control, the same button appeared further down on the page.

Total Sample: 2,970 Statistical Power at 5% MDE: 4.7%

Test #380 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Oct 27, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #21: What It's Worth On Getninjas.com.br

 - Variant A
 - Variant B

In this experimemt, the average $ gain from a performed service category was shown on a landing page. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,347 Statistical Power at 5% MDE: 14.2%

Test #378 on by Jakub LinowskiJakub Linowski Oct 07, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

 - Variant A
 - Variant B

Here we have an experiment with a variation that preselected an option for a club duration. The control required customers to first express the choice for how many months they would like to order a product for. Whereas the variation defaulted to 12 months from the beginning.

Impact on adds-to-cart and sales was measured. The experiment unfortunately had to be stopped early due to another embedded variation that was performing poorly. And so it does not have many transactions.

Total Sample: 2,953 Statistical Power at 5% MDE: 5.2%

Test #377 on Adoramapix.com by Jakub LinowskiJakub Linowski Sep 30, 2021 Desktop Shopping Cart X.X% Sales

Jakub Tested Pattern #121: Free Shipping On Adoramapix.com

 - Variant A
 - Variant B

In this experiment, a big "free shipping" badge was added and defaulted to when available. Impact on progression to checkouts and completed sales was measured.

Total Sample: 4,422 Statistical Power at 5% MDE: 85.5%

Test #376 on Snocks.com by Samuel HessSamuel Hess Sep 29, 2021 Mobile Desktop Product X.X% Sales

Samuel Tested Pattern #15: Bulleted Reassurances On Snocks.com

 - Variant A
 - Variant B

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

Total Sample: 136,126 Statistical Power at 5% MDE: 79.6%

Test #374 on Expertinstitute.com by Ardit VeliuArdit Veliu Sep 15, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #9: Multiple Steps On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, a lead form with numerous fields shown all at once, was broken down into 3 steps. The first step only asked for a Specialty choice that expanded into a list of options. Impact on full form completions was measured.

Total Sample: 5,628 Statistical Power at 5% MDE: 7.5%

Test #372 on Fluke.com by Marika FranciscoMarika Francisco Aug 30, 2021 Desktop Product X.X% Sales

Marika Tested Pattern #122: Zigzag Layout On Fluke.com

 - Variant A
 - Variant B

In this experiment, product descriptions were changed to an alternating zig zag layout with images. Impact on adds-to-cart and sales was measured.

Total Sample: 18,325 Statistical Power at 5% MDE: 3.2%

Test #371 on by Jakub LinowskiJakub Linowski Aug 18, 2021 Desktop Listing X.X% Sales

Jakub Tested Pattern #51: Shortcut Buttons

 - Variant A
 - Variant B

In this experiment, the variation added an extra "Buy Now" button that linked directly into the cart process. The variation only had a learn more button linking directly to a product page.

Total Sample: 3,041 Statistical Power at 5% MDE: 10.4%

Test #370 on Thomasnet.com by Julian GaviriaJulian Gaviria Aug 16, 2021 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

 - Variant A
 - Variant B

This experiment added the simple verb ("play") before the "factory video" label to encourage more video plays. Impact on progression / clicks was measured.

Total Sample: 259,330 Statistical Power at 5% MDE: 49%