All Latest 645 A/B Tests

Test #381 on Expertinstitute.com by Ardit VeliuArdit Veliu Oct 30, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #49: Above The Fold Call To Action On Expertinstitute.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

In this experiment, an extra button to a signup lead form was placed above the fold. In the control, the same button appeared further down on the page.

Total Sample: 2,970 • Statistical Power at 5% MDE: 4.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #377 on Adoramapix.com by Jakub LinowskiJakub Linowski Sep 30, 2021 Desktop Shopping Cart X.X% Sales

Jakub Tested Pattern #121: Free Shipping On Adoramapix.com

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this experiment, a big "free shipping" badge was added and defaulted to when available. Impact on progression to checkouts and completed sales was measured.

Total Sample: 4,422 • Statistical Power at 5% MDE: 85.5%

Test #376 on Snocks.com by Samuel HessSamuel Hess Sep 29, 2021 Mobile Desktop Product X.X% Sales

Samuel Tested Pattern #15: Bulleted Reassurances On Snocks.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

Total Sample: 136,126 • Statistical Power at 5% MDE: 79.6%

Test #371 by Jakub LinowskiJakub Linowski Aug 18, 2021 Desktop Listing X.X% Sales

Jakub Tested Pattern #51: Shortcut Buttons

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this experiment, the variation added an extra "Buy Now" button that linked directly into the cart process. The variation only had a learn more button linking directly to a product page.

Total Sample: 3,041 • Statistical Power at 5% MDE: 10.4%

Test #370 on Thomasnet.com by Julian GaviriaJulian Gaviria Aug 16, 2021 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

This experiment added the simple verb ("play") before the "factory video" label to encourage more video plays. Impact on progression / clicks was measured.

Total Sample: 259,330 • Statistical Power at 5% MDE: 49%

Test #368 on Mvideo.ru by Andrey AndreevAndrey Andreev Aug 02, 2021 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, popular categories were added at the bottom of a long ecommerce homepage. Impact on total sales was measured.

Total Sample: 2,278,698 • Statistical Power at 5% MDE: 99.9%

Test #367 on Backstage.com by Stanley ZuoStanley Zuo Jul 22, 2021 Desktop Mobile Signup X.X% Sales

Stanley Tested Pattern #124: Confirmed Selection On Backstage.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, a confiming text was added at the top of a signup modal. The text reinforced the selection from a previous listing page, giving a good reason for continuing the signup process.

Total Sample: 29,480 • Statistical Power at 5% MDE: 14.3%

Test #365 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 13, 2021 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Mvideo.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, reviews on product pages were exposed completely. Instead of hiding them under a clickable tab, they were shown by default in the variation. Impact on sales was measured.

Total Sample: 78,120 • Statistical Power at 5% MDE: 16.1%

Test #364 on Lotuscrafts.eu by Samuel HessSamuel Hess Jul 06, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Lotuscrafts.eu

Pattern #122: Zigzag Layout - Variant A
Pattern #122: Zigzag Layout - Variant B

In this experiment, product descriptions or qualities were added using a zigzag layout pattern composed of photos and extra copy. This sections was appended between existing copy and testimonials. Some of the copy highlights included wording such as "innovative surface", "non-slip and wide", and "skin-friendly". Impact on adds-to-cart and sales was measured.

Total Sample: 32,392 • Statistical Power at 5% MDE: 29.1%

Test #363 by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 • Statistical Power at 5% MDE: 33.9%

Test #362 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Jun 23, 2021 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #7: Social Counts On Vivareal.com.br

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, the number of recent property views was displayed under the call to action. Impact on overall lead generation was measured. (Translated using Google from Brazilian Portuguese.)

Total Sample: 7,087,369 • Statistical Power at 5% MDE: 99.9%

Test #360 by Jakub LinowskiJakub Linowski Jun 16, 2021 Desktop Product X.X% Sales

Jakub Tested Pattern #60: Repeated Bottom Call To Action

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a comparison chart with various purchasing options was appended at the bottom of a product page. 

Total Sample: 32,070 • Statistical Power at 5% MDE: 35.1%

Test #359 on Snocks.com by Samuel HessSamuel Hess Jun 11, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this experiment, product titles were extended with descriptive copy. Instead of just showing the product name, "with organic cotton" was appended on product and category/listing pages. Impact to adds to cart and sales was measured.

Total Sample: 129,030 • Statistical Power at 5% MDE: 79.9%

Test #356 on Mvideo.ru by Andrey AndreevAndrey Andreev May 29, 2021 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Total Sample: 5,469,900 • Statistical Power at 5% MDE: 99.9%

Test #354 on Mvideo.ru by Andrey AndreevAndrey Andreev May 25, 2021 Desktop Mobile Product X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Mvideo.ru

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

In this experiment, the discounted price was shown along with an active promotion. The control only showed that the relative -8% discount was present with the pre-discounted price.

Test #350 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 29, 2021 Desktop Content X.X% Leads

Ardit Tested Pattern #16: Welcome Mat - Partial On Expertinstitute.com

Pattern #16: Welcome Mat - Partial - Variant A
Pattern #16: Welcome Mat - Partial - Variant B

In this experiment, a lead generating section with a call to action (welcome mat) was appended at the top of article pages. Impact on lead generation was measured.

Total Sample: 34,967 • Statistical Power at 5% MDE: 3.9%

Test #349 on Backstage.com by Stanley ZuoStanley Zuo Apr 27, 2021 Mobile Global X.X% Sales

Stanley Tested Pattern #49: Above The Fold Call To Action On Backstage.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

In this experiment, a simple "Join Now" button was added inside an expanded mobile navigation menu. Clicking the button would start a multiple step membership subscription process. Impact on subscription starts and final sales were tracked.

Total Sample: 950,043 • Statistical Power at 5% MDE: 37.9%

Test #346 by Stanley ZuoStanley Zuo Mar 30, 2021 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #117: Company Logos

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this homepage experiment, company logos were added to the homepage. These were example clients or companies that Backstage works with and offers casting (job) listing from. Impact on the registration flow and membership checkouts was measured.

Total Sample: 221,012 • Statistical Power at 5% MDE: 43.1%

Test #344 by Jakub LinowskiJakub Linowski Mar 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

Three common delivery questions were answered at the bottom of a checkout page. 

Total Sample: 18,871 • Statistical Power at 5% MDE: 50.1%

Test #340 by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 • Statistical Power at 5% MDE: 97.3%