All Latest 633 A/B Tests

MOST RECENT TESTS

Test #466 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Apr 26, 2023 Desktop Signup X.X% Sales

Daria Tested Pattern #4: Testimonials On Volders.de

 - Variant A
 - Variant B

In this experiment, a social proof popups were added to the signup / funnel pages for a contract cancellation service. The added social testimonials appeared as other customers used the service, anywhere except on the final checkout page. Additionaly, the interval at which these messaged appeared was 60 seconds, and they were shown for 10s. The messages translated to "[Name] had recently canncelled a contract with [Company], in the last 38 minutes". Impact on sales was measured.

Total Sample: 47,801 Statistical Power at 5% MDE: 64.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #465 on by Melina HessMelina Hess Apr 22, 2023 Desktop Mobile Product X.X% Revenue

Melina Tested Pattern #15: Bulleted Reassurances

 - Variant A
 - Variant B

In this product detail page experiment, a number of reassurances were brought out visually in a lined or bulleted way. The 4 reassurances included: free shipping and returns; Made in Germany, 90 Day Returns; and Buy With Invoice (popular in Germany). Impact on revenue per user was measured. The control contained very feint copy (smaller and more subtle) about free shipping.

Test #464 on Expertinstitute.com by Ardit VeliuArdit Veliu Mar 31, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #7: Social Counts On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

Total Sample: 10,448 Statistical Power at 5% MDE: 8%

Test #463 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Mar 25, 2023 Desktop Checkout X.X% Sales

Daria Tested Pattern #115: Pricing Comparison Table On Volders.de

 - Variant A
 - Variant B

This experiment explored a pricing layout that enabled more feature comparisons. It also conveyed more clearly which features were missing between plans. The test has been inspired by this Netflix experiment. Impact on sales was measured.

Total Sample: 23,336 Statistical Power at 5% MDE: 84.8%

Test #462 on by Jakub LinowskiJakub Linowski Mar 24, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #128: Standard Or Superscript Price Format

 - Variant A
 - Variant B

In this experiment, standard $ signs and cents were formatted into a smaller superscript. Impact on add-to-cart and sales was measured.

Total Sample: 46,737 Statistical Power at 5% MDE: 35%

Test #459 on Snocks.com by Melina HessMelina Hess Feb 28, 2023 Desktop Mobile Listing X.X% Sales

Melina Tested Pattern #36: Fewer Or More Results On Snocks.com

 - Variant A
 - Variant B

In this listing page experiment, color sets of the same product were tested against individual products with unique colors (with additional product tiles). Essentially, the A version here contained fewer product items (with color sets), while the B version contained more results and tiles (with grouped products). Impact on total sales was measured.

(The original control and variation was inverted, but was flipped to match the fewer or more results pattern).

Total Sample: 185,702 Statistical Power at 5% MDE: 99.2%

Test #458 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Feb 27, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #103: Money Back Guarantee On Volders.de

 - Variant A
 - Variant B

In this experiment, a cancelation guarantee was added believing it would make users feel safer while canceling their contracts with Volders (the paid service being offered). The variation appended a Guarantee in the headline as a hyperlink with an explanatory tooltip shown on hover. This variation change was added to multiple screens throughout the checkout flow (a 5 step process).

Total Sample: 21,648 Statistical Power at 5% MDE: 31.6%

Test #457 on by Jakub LinowskiJakub Linowski Feb 26, 2023 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #64: Tunnel

 - Variant A
 - Variant B

In this experiment, hamburger navigation with product links, was removed from the shopping / add to cart page. Tertiary links (How It Works, Guarantee details and support pages) were also removed, while a "Secure Checkout" message was brought into the header. This header version was already present on the next checkout page, and was copied over one step earlier. The idea was to keep customers within the checkout flow. Impact on sales was measured.

Total Sample: 4,452 Statistical Power at 5% MDE: 48.6%

Test #456 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Feb 23, 2023 Desktop Mobile Signup X.X% Sales

Daria Tested Pattern #28: Easiest Fields First On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, a more difficult step of a contract cancelation service flow was rearranged toward a later step. In the variation, the easier step (hypothetically) with personal details and address fields was placed as the first step. Whereas the step with contract or account numbers (hypothetically more difficult) were placed as the second step.

Total Sample: 138,384 Statistical Power at 5% MDE: 92.7%

Test #455 on Expertinstitute.com by Ardit VeliuArdit Veliu Feb 16, 2023 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #117: Company Logos On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, supporting university logos were appended near the primary call to action for additional credibility. These logos were placed around the middle of long landing pages on Expert Institute's web site (where experts for legal advice are searched). Impact on total leads was measured.

Total Sample: 5,706 Statistical Power at 5% MDE: 7.8%

Test #453 on by Jakub LinowskiJakub Linowski Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Jakub Tested Pattern #64: Tunnel

 - Variant A
 - Variant B

In this experiment, the footer was simplified with multiple elements being removed (catalog request, secondary links, and a guarantee). Additionally, a more prominent phone number was also displayed.

Total Sample: 17,107 Statistical Power at 5% MDE: 91.8%

Test #454 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

 - Variant A
 - Variant B

In this shopping cart experiment, a tall footer was completely removed. The footer contained elements such as: app download links, a newsletter signup, secondary web site links, trust symbols, social media icons and company contant information. Impact on sales was measured.

Total Sample: 18,201 Statistical Power at 5% MDE: 51.9%

Test #452 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jan 30, 2023 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #62: Urgent Next Day Delivery On Volders.de

 - Variant A
 - Variant B

In this experiment, a count down timer was added near the top of a checkout page. The timer was only shown before 1pm and clarified that the serivce (contract cancellation) will be initiated on the same day if users act before a cut off time. Impact on completed payments was measured.

Total Sample: 40,999 Statistical Power at 5% MDE: 99%

Test #451 on Fluke.com by Marika FranciscoMarika Francisco Jan 25, 2023 Desktop Product X.X% Sales

Marika Tested Pattern #115: Pricing Comparison Table On Fluke.com

 - Variant A
 - Variant B

In this experiment, a product comparison table was added in the middle of a product detail page. The comparison table contained products from the same class or family of products. Clicking on the photo thumbnails also allowed customers to visit the specific detail page. Impact on adds to cart and transactions was measured.

Total Sample: 52,560 Statistical Power at 5% MDE: 4.8%

Test #450 on Trenyrkarna.cz by Ondřej IlinčevOndřej Ilinčev Jan 20, 2023 Desktop Shopping Cart X.X% Sales

Ondřej Tested Pattern #64: Tunnel On Trenyrkarna.cz

 - Variant A
 - Variant B

In this experiment, top category navigation (with fly out categories) was removed from the shopping cart of an online store. Impact on sale transactions was measured.

Total Sample: 4,737 Statistical Power at 5% MDE: 25.4%

Test #449 on Snocks.com by Melina HessMelina Hess Dec 31, 2022 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #78: Tags, Badges And Structured Information On Snocks.com

 - Variant A
 - Variant B

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

Total Sample: 508,908 Statistical Power at 5% MDE: 99.9%

Test #448 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 30, 2022 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #21: What It's Worth On Zapimoveis.com.br

 - Variant A
 - Variant B

In this experiment, the B variation showed the relative discount in price from within the most recent 12 months as a percentage point. A tooltip was also shown which explained this message on hover. 

Total Sample: 136,584 Statistical Power at 5% MDE: 97.6%

Test #446 on by Jakub LinowskiJakub Linowski Dec 15, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #18: Single Or Alternative Buttons

 - Variant A
 - Variant B

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Total Sample: 100,016 Statistical Power at 5% MDE: 57.5%

Test #445 on Phorest.com by Sorcha MullisSorcha Mullis Dec 14, 2022 Desktop Mobile Home & Landing X.X% Leads

Sorcha Tested Pattern #33: Example Situations On Phorest.com

 - Variant A
 - Variant B

In this experiment, five clickable feature elements were surfaced on the homepage. Clicking on any of these 5 elements launched an Instastory-like short 10 second video in full screen. These videos explained the key features of the software being offered. Impact on lead generation was measured.

Total Sample: 132,525 Statistical Power at 5% MDE: 11.1%

Test #442 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 27, 2022 Desktop Mobile Home & Landing X.X% Sales

Daria Tested Pattern #4: Testimonials On Volders.de

 - Variant A
 - Variant B

In this experiment, three testimonials were appended at the bottom of landing pages of a contract cancelation service (paid). These testimonials were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Total Sample: 73,143 Statistical Power at 5% MDE: 83.7%