All Latest 633 A/B Tests

MOST RECENT TESTS

Test #369 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Aug 05, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #7: Social Counts On Getninjas.com.br

 - Variant A
 - Variant B

In this experimemt, the number of service requests per month were shown that people can expect after signing up in a given category. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,256 Statistical Power at 5% MDE: 14%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #368 on Mvideo.ru by Andrey AndreevAndrey Andreev Aug 02, 2021 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, popular categories were added at the bottom of a long ecommerce homepage. Impact on total sales was measured.

Total Sample: 2,278,698 Statistical Power at 5% MDE: 99.9%

Test #367 on Backstage.com by Stanley ZuoStanley Zuo Jul 22, 2021 Desktop Mobile Signup X.X% Sales

Stanley Tested Pattern #124: Confirmed Selection On Backstage.com

 - Variant A
 - Variant B

In this experiment, a confiming text was added at the top of a signup modal. The text reinforced the selection from a previous listing page, giving a good reason for continuing the signup process.

Total Sample: 29,480 Statistical Power at 5% MDE: 14.3%

Test #366 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.

Total Sample: 80,881 Statistical Power at 5% MDE: 95%

Test #364 on Lotuscrafts.eu by Samuel HessSamuel Hess Jul 06, 2021 Desktop Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Lotuscrafts.eu

 - Variant A
 - Variant B

In this experiment, product descriptions or qualities were added using a zigzag layout pattern composed of photos and extra copy. This sections was appended between existing copy and testimonials. Some of the copy highlights included wording such as "innovative surface", "non-slip and wide", and "skin-friendly". Impact on adds-to-cart and sales was measured.

Total Sample: 32,392 Statistical Power at 5% MDE: 29.1%

Test #363 on by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

 - Variant A
 - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 Statistical Power at 5% MDE: 33.9%

Test #362 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Jun 23, 2021 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #7: Social Counts On Vivareal.com.br

 - Variant A
 - Variant B

In this experiment, the number of recent property views was displayed under the call to action. Impact on overall lead generation was measured. (Translated using Google from Brazilian Portuguese.)

Total Sample: 7,087,369 Statistical Power at 5% MDE: 99.9%

Test #361 on Chaosgroup.com by Velin PenevVelin Penev Jun 22, 2021 Desktop Product X.X% Sales

Velin Tested Pattern #49: Above The Fold Call To Action On Chaosgroup.com

 - Variant A
 - Variant B

In this experiment, a pricing plan selector was shifted from the very bottom of a long product page towards (almost) the top. Impact on any transactions or sales was measured.

Total Sample: 49,030 Statistical Power at 5% MDE: 6.5%

Test #360 on by Jakub LinowskiJakub Linowski Jun 16, 2021 Desktop Product X.X% Sales

Jakub Tested Pattern #60: Repeated Bottom Call To Action

 - Variant A
 - Variant B

In this experiment, a comparison chart with various purchasing options was appended at the bottom of a product page. 

Total Sample: 32,070 Statistical Power at 5% MDE: 35.1%

Test #359 on Snocks.com by Samuel HessSamuel Hess Jun 11, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

 - Variant A
 - Variant B

In this experiment, product titles were extended with descriptive copy. Instead of just showing the product name, "with organic cotton" was appended on product and category/listing pages. Impact to adds to cart and sales was measured.

Total Sample: 129,030 Statistical Power at 5% MDE: 79.9%

Test #358 on Preply.com by Gleb HodorovskiyGleb Hodorovskiy Jun 03, 2021 Desktop Home & Landing X.X% Sales

Gleb Tested Pattern #58: Full Height False Bottom On Preply.com

 - Variant A
 - Variant B

In this experiment, the header section of the homepage drastically focused around the call to action. This was done by removing elements and forcing a false bottom.

Total Sample: 133,252 Statistical Power at 5% MDE: 14.8%

Test #357 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Jun 02, 2021 Desktop Mobile Pricing X.X% Signups

Brian Tested Pattern #113: More Or Fewer Plans On Baremetrics.com

 - Variant A
 - Variant B

In this experiment, a single focus signup was transformed into a pricing comparison table. Impact on signups was measured.

Total Sample: 4,947 Statistical Power at 5% MDE: 5.5%

Test #356 on Mvideo.ru by Andrey AndreevAndrey Andreev May 29, 2021 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Total Sample: 5,469,900 Statistical Power at 5% MDE: 99.9%

Test #355 on by Jakub LinowskiJakub Linowski May 28, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #79: Product Highlights

 - Variant A
 - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 Statistical Power at 5% MDE: 30.7%

Test #354 on Mvideo.ru by Andrey AndreevAndrey Andreev May 25, 2021 Desktop Mobile Product X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, the discounted price was shown along with an active promotion. The control only showed that the relative -8% discount was present with the pre-discounted price.

Test #353 on Backstage.com by Stanley ZuoStanley Zuo May 12, 2021 Desktop Product X.X% Signups

Stanley Tested Pattern #13: Centered Forms & Buttons On Backstage.com

 - Variant A
 - Variant B

This experiment challanged a right aligned detail page. After clicking a result of a job role on a listing page, an overlay would appear on the right with the details. The variation used a full width screen instead - effectively centering the page.

Total Sample: 30,428 Statistical Power at 5% MDE: 53.6%

Test #352 on Us.flukecal.com by John HickeyJohn Hickey May 11, 2021 Desktop Global X.X% Leads

John Tested Pattern #123: Single Or Double Column Form Fields On Us.flukecal.com

 - Variant A
 - Variant B

In this experiment, single column (longer) form fields were tested against a two column layout (more compact).

Total Sample: 252 Statistical Power at 5% MDE: 4.5%

Test #78 on Mvideo.ru by Andrey AndreevAndrey Andreev May 06, 2021 Desktop Mobile Listing X.X% Sales

Andrey Tested Pattern #90: Out Of Stock Or In Stock Products On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, products which were out of stock were removed from listing pages and replaced with in stock ones (not visible in the screenshot). 

Total Sample: 5,404,332 Statistical Power at 5% MDE: 99.9%

Test #351 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Apr 30, 2021 Desktop Mobile Home & Landing X.X% Signups

Brian Tested Pattern #11: Gradual Reassurance On Baremetrics.com

 - Variant A
 - Variant B

In this experiment, static integration logos were replaced with selectable ones that reassured users to signup. After clicking an integration logo, a comparison chart would appear showing how Baremetrics improves upon a selected payment processor, along with a call to signup. Impact on signups was measured.

Total Sample: 24,416 Statistical Power at 5% MDE: 7%

Test #350 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 29, 2021 Desktop Content X.X% Leads

Ardit Tested Pattern #16: Welcome Mat - Partial On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, a lead generating section with a call to action (welcome mat) was appended at the top of article pages. Impact on lead generation was measured.

Total Sample: 34,967 Statistical Power at 5% MDE: 3.9%