All Latest 634 A/B Tests

Test #364 on Lotuscrafts.eu by Samuel HessSamuel Hess Jul 06, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Lotuscrafts.eu

 - Variant A
 - Variant B

In this experiment, product descriptions or qualities were added using a zigzag layout pattern composed of photos and extra copy. This sections was appended between existing copy and testimonials. Some of the copy highlights included wording such as "innovative surface", "non-slip and wide", and "skin-friendly". Impact on adds-to-cart and sales was measured.

Total Sample: 32,392 Statistical Power at 5% MDE: 29.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #363 on by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

 - Variant A
 - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 Statistical Power at 5% MDE: 33.9%

Test #362 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Jun 23, 2021 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #7: Social Counts On Vivareal.com.br

 - Variant A
 - Variant B

In this experiment, the number of recent property views was displayed under the call to action. Impact on overall lead generation was measured. (Translated using Google from Brazilian Portuguese.)

Total Sample: 7,087,369 Statistical Power at 5% MDE: 99.9%

Test #360 on by Jakub LinowskiJakub Linowski Jun 16, 2021 Desktop Product X.X% Sales

Jakub Tested Pattern #60: Repeated Bottom Call To Action

 - Variant A
 - Variant B

In this experiment, a comparison chart with various purchasing options was appended at the bottom of a product page. 

Total Sample: 32,070 Statistical Power at 5% MDE: 35.1%

Test #359 on Snocks.com by Samuel HessSamuel Hess Jun 11, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

 - Variant A
 - Variant B

In this experiment, product titles were extended with descriptive copy. Instead of just showing the product name, "with organic cotton" was appended on product and category/listing pages. Impact to adds to cart and sales was measured.

Total Sample: 129,030 Statistical Power at 5% MDE: 79.9%

Test #356 on Mvideo.ru by Andrey AndreevAndrey Andreev May 29, 2021 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Total Sample: 5,469,900 Statistical Power at 5% MDE: 99.9%

Test #354 on Mvideo.ru by Andrey AndreevAndrey Andreev May 25, 2021 Desktop Mobile Product X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, the discounted price was shown along with an active promotion. The control only showed that the relative -8% discount was present with the pre-discounted price.

Test #350 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 29, 2021 Desktop Content X.X% Leads

Ardit Tested Pattern #16: Welcome Mat - Partial On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, a lead generating section with a call to action (welcome mat) was appended at the top of article pages. Impact on lead generation was measured.

Total Sample: 34,967 Statistical Power at 5% MDE: 3.9%

Test #349 on Backstage.com by Stanley ZuoStanley Zuo Apr 27, 2021 Mobile Global X.X% Sales

Stanley Tested Pattern #49: Above The Fold Call To Action On Backstage.com

 - Variant A
 - Variant B

In this experiment, a simple "Join Now" button was added inside an expanded mobile navigation menu. Clicking the button would start a multiple step membership subscription process. Impact on subscription starts and final sales were tracked.

Total Sample: 950,043 Statistical Power at 5% MDE: 37.9%

Test #346 on by Stanley ZuoStanley Zuo Mar 30, 2021 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #117: Company Logos

 - Variant A
 - Variant B

In this homepage experiment, company logos were added to the homepage. These were example clients or companies that Backstage works with and offers casting (job) listing from. Impact on the registration flow and membership checkouts was measured.

Total Sample: 221,012 Statistical Power at 5% MDE: 43.1%

Test #344 on by Jakub LinowskiJakub Linowski Mar 11, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

 - Variant A
 - Variant B

Three common delivery questions were answered at the bottom of a checkout page. 

Total Sample: 18,871 Statistical Power at 5% MDE: 50.1%

Test #340 on by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop Checkout X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

 - Variant A
 - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 Statistical Power at 5% MDE: 97.3%

Test #339 on Expertinstitute.com by Ardit VeliuArdit Veliu Feb 23, 2021 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #33: Example Situations On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, a number of use cases examples were added to illustrate the situations in which experts could help. 

Total Sample: 8,388 Statistical Power at 5% MDE: 7.6%

Test #338 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 29, 2021 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #63: Trust Seals On Umbraco.com

 - Variant A
 - Variant B

In this experiment, the variation added three G2 badges or awards. The intent was to measure the impact of this change on signups for Umbraco.

Total Sample: 8,133 Statistical Power at 5% MDE: 5.5%

Test #336 on Backstage.com by Stanley ZuoStanley Zuo Jan 28, 2021 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #51: Shortcut Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, a listing page was expanded to show two actions (apply and view details) instead of a single one (view details only). This variation enabled users with a shortcut action to apply for roles one step earlier (and start membership flows for new users). 

Total Sample: 159,634 Statistical Power at 5% MDE: 16.1%

Test #334 on Thomasnet.com by Kyle PhillipsKyle Phillips Jan 25, 2021 Desktop Mobile Global X.X% Progression

Kyle Tested Pattern #2: Icon Labels On Thomasnet.com

 - Variant A
 - Variant B

This experiment measured the impact of adding text labels to three icon-only nav items. 

Total Sample: 60,466 Statistical Power at 5% MDE: 11.1%

Test #331 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this little experiment, an extra "Free Shipping" message was added on a product page. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 96,962 Statistical Power at 5% MDE: 83.6%

Test #332 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this experiment, an extra "Free Shipping" message was added on a product page - at the top of the buy box with an add-to-cart call to action. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 97,277 Statistical Power at 5% MDE: 83.7%

Test #329 on Snocks.com by Samuel HessSamuel Hess Dec 23, 2020 Mobile Home & Landing X.X% Sales

Samuel Tested Pattern #14: Exposed Menu Options On Snocks.com

 - Variant A
 - Variant B

In this homepage experiment, a series of product categories were shown more visible near the top of the screen (instead of only being shown inside the hamburger menu). They linked up to corresponding listing pages with such items as: gifts, short socks, long socks, and underwear. Impact on adds-to-cart and total sales was measured.

Total Sample: 58,462 Statistical Power at 5% MDE: 40.4%

Test #328 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 21, 2020 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #60: Repeated Bottom Call To Action On Umbraco.com

 - Variant A
 - Variant B

In this experiment, a trial signup section was added at the bottom of Umbraco's long homepage (CMS business). The experiment measured the impact on trial signups.

Total Sample: 57,371 Statistical Power at 5% MDE: 8.4%