All Latest 632 A/B Tests

Test #472 on Expertinstitute.com by Ardit VeliuArdit Veliu May 25, 2023 Desktop Mobile Home & Landing X.X% Progression

Ardit Tested Pattern #48: Video Testimonials On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, three video testimonials were added mid page onto a signup / lead form page.

Total Sample: 6,837 Statistical Power at 5% MDE: 9.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #468 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Apr 28, 2023 Desktop Mobile Home & Landing X.X% Progression

Lars Tested Pattern #6: Customer Star Ratings On Umbraco.com

 - Variant A
 - Variant B

In this homepage experiment a number of changes were introduced - with perhaps the most prominent one being the replacement of a video component with customer review badges. Additional copy changes included reinforcement of the latest version number (v11) throughout the page, as well as a dedicated (v11) section in the middle of the page. Impact on demo signups was measured.

Total Sample: 45,082 Statistical Power at 5% MDE: 13.2%

Test #467 on by Jakub LinowskiJakub Linowski Apr 27, 2023 Desktop Mobile Product X.X% Progression

Jakub Tested Pattern #108: Frequently Asked Questions

 - Variant A
 - Variant B

In this experiment, an FAQ section was added near the bottom of a long product page. The reviews were collapsed by default, but expandable upon clicking. Impact on adds-to-cart and sales was measured.

Total Sample: 24,703 Statistical Power at 5% MDE: 14.5%

Test #464 on Expertinstitute.com by Ardit VeliuArdit Veliu Mar 31, 2023 Desktop Mobile Home & Landing X.X% Progression

Ardit Tested Pattern #7: Social Counts On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, copy was added which showed the number of experts (in a given category) a person may gain access to after filling out a lead form. The context of this is a lead-gen landing page where people are seeking experts for legal purposes. Impact on initial progression (of a multi step form) and completed leads was measured.

Total Sample: 10,448 Statistical Power at 5% MDE: 8%

Test #462 on by Jakub LinowskiJakub Linowski Mar 24, 2023 Desktop Mobile Product X.X% Progression

Jakub Tested Pattern #128: Standard Or Superscript Price Format

 - Variant A
 - Variant B

In this experiment, standard $ signs and cents were formatted into a smaller superscript. Impact on add-to-cart and sales was measured.

Total Sample: 46,737 Statistical Power at 5% MDE: 35%

Test #460 on Backstage.com by Stanley ZuoStanley Zuo Mar 21, 2023 Mobile Listing X.X% Progression

Stanley Tested Pattern #41: Sticky Call To Action On Backstage.com

 - Variant A
 - Variant B

In this experiment, a floating top navigation was shown with a "Join" button. In the control, the navigation was only visible at the top of the page. Also keep in mind that signup starts were also triggered throughout multiple CTAs throughout the page and from particular job detail pages. The a/b test ran on a listing page of Backstage - a casting call job site. Impact on signups  and checkouts was measured.

Total Sample: 1,057,325 Statistical Power at 5% MDE: 41.8%

Test #458 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Feb 27, 2023 Desktop Mobile Checkout X.X% Progression

Daria Tested Pattern #103: Money Back Guarantee On Volders.de

 - Variant A
 - Variant B

In this experiment, a cancelation guarantee was added believing it would make users feel safer while canceling their contracts with Volders (the paid service being offered). The variation appended a Guarantee in the headline as a hyperlink with an explanatory tooltip shown on hover. This variation change was added to multiple screens throughout the checkout flow (a 5 step process).

Total Sample: 21,648 Statistical Power at 5% MDE: 31.6%

Test #453 on by Jakub LinowskiJakub Linowski Jan 31, 2023 Desktop Mobile Shopping Cart X.X% Progression

Jakub Tested Pattern #64: Tunnel

 - Variant A
 - Variant B

In this experiment, the footer was simplified with multiple elements being removed (catalog request, secondary links, and a guarantee). Additionally, a more prominent phone number was also displayed.

Total Sample: 17,107 Statistical Power at 5% MDE: 91.8%

Test #451 on Fluke.com by Marika FranciscoMarika Francisco Jan 25, 2023 Desktop Product X.X% Progression

Marika Tested Pattern #115: Pricing Comparison Table On Fluke.com

 - Variant A
 - Variant B

In this experiment, a product comparison table was added in the middle of a product detail page. The comparison table contained products from the same class or family of products. Clicking on the photo thumbnails also allowed customers to visit the specific detail page. Impact on adds to cart and transactions was measured.

Total Sample: 52,560 Statistical Power at 5% MDE: 4.8%

Test #447 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 23, 2022 Mobile Listing X.X% Progression

Vinicius Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

 - Variant A
 - Variant B

In this experiment, an additional call to action (Whatsapp link) was added on a listing page of one of Brazil's largest real estate sites.In the variation the 3 calls to action include: a link that launched the phone interaction, a general contact lead form, and finally the Whatsapp link (added in the variant).  Impact on total lead starts and completions was measured.

Total Sample: 1,416,128 Statistical Power at 5% MDE: 99.9%

Test #446 on by Jakub LinowskiJakub Linowski Dec 15, 2022 Desktop Mobile Product X.X% Progression

Jakub Tested Pattern #18: Single Or Alternative Buttons

 - Variant A
 - Variant B

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Total Sample: 100,016 Statistical Power at 5% MDE: 57.5%

Test #442 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 27, 2022 Desktop Mobile Home & Landing X.X% Progression

Daria Tested Pattern #4: Testimonials On Volders.de

 - Variant A
 - Variant B

In this experiment, three testimonials were appended at the bottom of landing pages of a contract cancelation service (paid). These testimonials were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Total Sample: 73,143 Statistical Power at 5% MDE: 83.7%

Test #443 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 27, 2022 Desktop Mobile Home & Landing X.X% Progression

Daria Tested Pattern #4: Testimonials On Volders.de

 - Variant A
 - Variant B

In this experiment, four TrustPilot reviews were appended at the bottom of landing pages of a contract cancelation service (paid). These reviews were also shown throughout the complete signup funnel (4 more steps). Impact on progression (step 2) and final completed purchases were measured.

Total Sample: 72,943 Statistical Power at 5% MDE: 83.6%

Test #430 on by Jakub LinowskiJakub Linowski Sep 20, 2022 Desktop Product X.X% Progression

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

In this experiment, up to 5 recently viewed product pages would appear on the left hand navigation. The idea was to make it easier for users get back to what they were looking at in case they were browsing. These recently viewed products were not visibile in the control. Impact on adds-to-cart and completed transactions was measured.

Total Sample: 10,324 Statistical Power at 5% MDE: 28%

Test #427 on Designlab.com by Daniel ShapiroDaniel Shapiro Aug 10, 2022 Desktop Mobile Checkout X.X% Progression

Daniel Tested Pattern #28: Easiest Fields First On Designlab.com

 - Variant A
 - Variant B

In this experiment, the course enrollment start date was moved from step 2 to step 1 of an enrollment / checkout flow. The test was run by Designlab - that offers design courses and education with a strong element of mentorship. Impact on progression to next step and completed transactions were measured.

Total Sample: 12,185 Statistical Power at 5% MDE: 15.3%

Test #425 on by Jakub LinowskiJakub Linowski Aug 03, 2022 Desktop Product X.X% Progression

Jakub Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment, the complete buy box on a product detail page, floated along as users scrolled through the long screen. The variation made sure the product choice and order now button was always visible. Impact on adds-to-cart and sales was measured.

Total Sample: 8,174 Statistical Power at 5% MDE: 13.8%

Test #422 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jul 22, 2022 Desktop Mobile Shopping Cart X.X% Progression

Daria Tested Pattern #3: Fewer Form Fields On Volders.de

 - Variant A
 - Variant B

A birthdate field was removed during a signup process for a paid contract cancellation service. Impact on progression (next step) and sales (completed transactions) was measured.

Total Sample: 20,345 Statistical Power at 5% MDE: 16.6%

Test #419 on by Jakub LinowskiJakub Linowski Jun 29, 2022 Desktop Home & Landing X.X% Progression

Jakub Tested Pattern #68: Welcome Discount

 - Variant A
 - Variant B

In this experiment, the presence of a discount modal (bigger discount for larger purchases) was tested on home and product pages. The trigger happend after a scroll down, a few second pause, and a mouse scroll up interaction. Impact on sales was measured.

Total Sample: 196,639 Statistical Power at 5% MDE: 98.5%

Test #413 on by Jakub LinowskiJakub Linowski May 26, 2022 Desktop Mobile Shopping Cart X.X% Progression

Jakub Tested Pattern #114: Less Or More Visible Prices

 - Variant A
 - Variant B

Should prices be displayed during an editing state on an add-to-cart screen (after adding-to-cart from a product detail page)? In this experiment, club pricing was added and shown in three areas after customers clicked on a small "edit details" links. The control did not have this pricing information (which was only shown on a product detail screen before).

Total Sample: 5,698 Statistical Power at 5% MDE: 59.9%

Test #411 on by Ayat ShukairyAyat Shukairy May 09, 2022 Desktop Mobile Product X.X% Progression

Ayat Tested Pattern #126: Bottom Or Left Thumbnails

 - Variant A
 - Variant B

Bottom aligned thumbnails were shifted to the left side on a product image. Doing so, also shifted the product descriptions a little higher. Impact on adds-to-cart and total transactions was measured.

Total Sample: 588,443 Statistical Power at 5% MDE: 70.1%