All Latest 650 A/B Tests

Test #496 on Livefresh.de by Pascal DietzPascal Dietz Oct 03, 2023 Desktop Mobile Product X.X% Sales

Pascal Tested Pattern #43: Long Titles On Livefresh.de

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this product detail page experiment a simple subheadline was appended to a new product. The tagline read "Lose weight sustainably and healthily." (Google translated from German "Nachhaltig und gesund Gewicht verlieren."). Impact on sales and revenue was measured.

Total Sample: 68,822 • Statistical Power at 5% MDE: 51.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #494 on Online.Metro-cc.ru by Andrey AndreevAndrey Andreev Sep 20, 2023 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #26: Cart Reminder And Recently Viewed On Online.Metro-cc.ru

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, recently purchased products were appended at the top of the homepage. The test ran for loggedin users only. Impact on add-to-cart, sales and revenue was measured.

Total Sample: 53,513 • Statistical Power at 5% MDE: 78.3%

Test #492 on Formelskin.de by Alexander KriegerAlexander Krieger Sep 15, 2023 Mobile Signup X.X% Sales

Alexander Tested Pattern #131: Authority On Formelskin.de

Pattern #131: Authority - Variant A
Pattern #131: Authority - Variant B

This experiment was a retest of a previously tested test 491. Simiarly, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow in the variation. 

Total Sample: 26,270 • Statistical Power at 5% MDE: 17%

Test #491 on Formelskin.de by Alexander KriegerAlexander Krieger Sep 08, 2023 Mobile Signup X.X% Sales

Alexander Tested Pattern #131: Authority On Formelskin.de

Pattern #131: Authority - Variant A
Pattern #131: Authority - Variant B

In this experiment, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow. In the control version, the photo with introduction was only shown on the first screen. In the variation, the photo appeared on the first and all other screens - reinforcing expertise, authority and the idea of a consultation. Impact on signups and purchases was measured.

Total Sample: 18,949 • Statistical Power at 5% MDE: 13.1%

Test #488 on Metro-cc.ru by Andrey AndreevAndrey Andreev Aug 11, 2023 Mobile Product X.X% Sales

Andrey Tested Pattern #4: Testimonials On Metro-cc.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, customer reviews were shown on product detail pages. Impact on adds to cart and sales was measured.

Total Sample: 103,655 • Statistical Power at 5% MDE: 13.7%

Test #486 on Livefresh.de by Pascal DietzPascal Dietz Aug 03, 2023 Mobile Product X.X% Sales

Pascal Tested Pattern #78: Tags, Badges And Structured Information On Livefresh.de

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

Total Sample: 416,423 • Statistical Power at 5% MDE: 98.8%

Test #483 on Menufy.com by Aleksandr ElesevAleksandr Elesev Jul 17, 2023 Desktop Checkout X.X% Sales

Aleksandr Tested Pattern #124: Confirmed Selection On Menufy.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment, a thanking confirmation message was appended at the top of the checkout screen of a local food delivery service. Impact on completed transactions was measured.

Total Sample: 8,626 • Statistical Power at 5% MDE: 99.9%

Test #481 on Backstage.com by Stanley ZuoStanley Zuo Jul 14, 2023 Desktop Mobile Checkout X.X% Sales

Stanley Tested Pattern #15: Bulleted Reassurances On Backstage.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, selling points and benefits of a subscription were placed as bullets at the top of a checkout page. The benefits highlighted things such as: unlimited applications, access to vetted jobs and the ability to cancel anytime. Impact on sales was measured.

Total Sample: 5,616 • Statistical Power at 5% MDE: 24.3%

Test #479 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. Benefit items not included in the lower plans were also shown with grayed out styles (and an "x"). Clearly the higher paid plan had all the benefits listed. Impact on transactions was measured. 

Total Sample: 104,863 • Statistical Power at 5% MDE: 93%

Test #480 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Jun 15, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #15: Bulleted Reassurances On Aboalarm.de

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

In this experiment, a list of benefits were shown for each of the 3 plans on the last step of a contract cancelation service. The lowest plan only had one benefit, whereas the highest plan had 3. Impact on transactions was measured. 

Total Sample: 104,902 • Statistical Power at 5% MDE: 93%

Test #475 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 07, 2023 Desktop Mobile Listing X.X% Sales

Andrey Tested Pattern #36: Fewer Or More Results On Online.metro-cc.ru

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B

Are more (popular) product results better than none at all? In this experiment, popular products were shown during an empty search result. Impact on sales was measured.

Total Sample: 22,070 • Statistical Power at 5% MDE: 12.1%

Test #474 on Rollbar.com by Mike SmithMike Smith May 27, 2023 Desktop Mobile Home & Landing X.X% Signups

Mike Tested Pattern #4: Testimonials On Rollbar.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, 9 Twitter card style testimonials were appended onto the homepage of Rollbar. These were image / screenshots recreations without links to the actual tweets.

Total Sample: 10,223 • Statistical Power at 5% MDE: 7.7%

Test #471 on Expertinstitute.com by Ardit VeliuArdit Veliu May 25, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #48: Video Testimonials On Expertinstitute.com

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, a video testimonial was added mid page onto a signup / lead form page.

Total Sample: 6,837 • Statistical Power at 5% MDE: 9.8%

Test #472 on Expertinstitute.com by Ardit VeliuArdit Veliu May 25, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #48: Video Testimonials On Expertinstitute.com

Pattern #48: Video Testimonials - Variant A
Pattern #48: Video Testimonials - Variant B

In this experiment, three video testimonials were added mid page onto a signup / lead form page.

Total Sample: 6,837 • Statistical Power at 5% MDE: 9.8%

Test #467 by Jakub LinowskiJakub Linowski Apr 27, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

In this experiment, an FAQ section was added near the bottom of a long product page. The reviews were collapsed by default, but expandable upon clicking. Impact on adds-to-cart and sales was measured.

Total Sample: 24,703 • Statistical Power at 5% MDE: 14.5%

Test #466 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Apr 26, 2023 Desktop Signup X.X% Sales

Daria Tested Pattern #4: Testimonials On Volders.de

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a social proof popups were added to the signup / funnel pages for a contract cancellation service. The added social testimonials appeared as other customers used the service, anywhere except on the final checkout page. Additionaly, the interval at which these messaged appeared was 60 seconds, and they were shown for 10s. The messages translated to "[Name] had recently canncelled a contract with [Company], in the last 38 minutes". Impact on sales was measured.

Total Sample: 47,801 • Statistical Power at 5% MDE: 64.9%

Test #464 on Expertinstitute.com by Ardit VeliuArdit Veliu Mar 31, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #7: Social Counts On Expertinstitute.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

Total Sample: 10,448 • Statistical Power at 5% MDE: 8%

Test #460 on Backstage.com by Stanley ZuoStanley Zuo Mar 21, 2023 Mobile Listing X.X% Sales

Stanley Tested Pattern #41: Sticky Call To Action On Backstage.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating top navigation was shown with a "Join" button. In the control, the navigation was only visible at the top of the page. Also keep in mind that signup starts were also triggered throughout multiple CTAs throughout the page and from particular job detail pages. The a/b test ran on a listing page of Backstage - a casting call job site. Impact on signups  and checkouts was measured.

Total Sample: 1,057,325 • Statistical Power at 5% MDE: 41.8%

Test #458 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Feb 27, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #103: Money Back Guarantee On Volders.de

Pattern #103: Money Back Guarantee - Variant A
Pattern #103: Money Back Guarantee - Variant B

In this experiment, a cancelation guarantee was added believing it would make users feel safer while canceling their contracts with Volders (the paid service being offered). The variation appended a Guarantee in the headline as a hyperlink with an explanatory tooltip shown on hover. This variation change was added to multiple screens throughout the checkout flow (a 5 step process).

Total Sample: 21,648 • Statistical Power at 5% MDE: 31.6%

Test #455 on Expertinstitute.com by Ardit VeliuArdit Veliu Feb 16, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #117: Company Logos On Expertinstitute.com

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, supporting university logos were appended near the primary call to action for additional credibility. These logos were placed around the middle of long landing pages on Expert Institute's web site (where experts for legal advice are searched). Impact on total leads was measured.

Total Sample: 5,706 • Statistical Power at 5% MDE: 7.8%