All Latest 634 A/B Tests

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Progression

Lars Tested Pattern #79: Product Highlights On Umbraco.com

 - Variant A
 - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 Statistical Power at 5% MDE: 3.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #278 on by Someone Someone Jan 15, 2020 Mobile Shopping Cart X.X% Progression

Someone Tested Pattern #64: Tunnel

 - Variant A
 - Variant B

In this experiment, multiple elemenets were removed from the bottom of the cart page. This was done to see if they were potential distractions that hindered the purchase process. The elements included such things as: Order details (visible on other pages), large product photo, a "what you receive" section with selling points, more reassurances, and a newsletter subscribe box.

Total Sample: 1,369 Statistical Power at 5% MDE: 12%

Test #270 on Dentalplans.com by J.R. HernandezJ.R. Hernandez Nov 19, 2019 Desktop Listing X.X% Progression

J.R. Tested Pattern #37: List Or Grid View On Dentalplans.com

 - Variant A
 - Variant B

In this experiment, a list view was tested against a grid view.

Total Sample: 264,000 Statistical Power at 5% MDE: 48.1%

Test #269 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 15, 2019 Desktop Home & Landing X.X% Progression

Julian Tested Pattern #14: Exposed Menu Options On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the variation exposed 6 of the options from the pulldown menu as tabs.

Total Sample: 6,168 Statistical Power at 5% MDE: 6.7%

Test #268 on Backstage.com by Stanley ZuoStanley Zuo Nov 08, 2019 Mobile Listing X.X% Progression

Stanley Tested Pattern #14: Exposed Menu Options On Backstage.com

 - Variant A
 - Variant B

The change in this experiment was an exposed SEO panel (B) with a number of clickable filter options. 

Total Sample: 208,456 Statistical Power at 5% MDE: 97%

Test #267 on Backstage.com by Stanley ZuoStanley Zuo Nov 05, 2019 Mobile Checkout X.X% Progression

Stanley Tested Pattern #99: Progress Bar On Backstage.com

 - Variant A
 - Variant B

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.

Total Sample: 8,552 Statistical Power at 5% MDE: 6%

Test #266 on by Someone Someone Oct 25, 2019 Desktop Mobile Product X.X% Progression

Someone Tested Pattern #4: Testimonials

 - Variant A
 - Variant B

In this experiment, a product page showed customer reviews at the bottom of the page (B) instead of hiding them under a tab (A).

Total Sample: 17,139 Statistical Power at 5% MDE: 15.4%

Test #264 on Kenhub.com by Niels HapkeNiels Hapke Oct 05, 2019 Desktop Mobile Global X.X% Progression

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

 - Variant A
 - Variant B

In this experiment users saw a sticky bar advertising the benefits of a Premium account across the bottom of the website, wherever they navigate. The sticky call to action appeared with a 4 second delay and was floating.

Total Sample: 50,572 Statistical Power at 5% MDE: 20.3%

Test #262 on Thomasnet.com by Julian GaviriaJulian Gaviria Oct 03, 2019 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #32: Condensed List On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the B version condensed the company listings. This was done by showing less of the description and introducing a "more" and "less" dynamic links that would expand and collapse the description.

Total Sample: 105,732 Statistical Power at 5% MDE: 8.6%

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Progression

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

 - Variant A
 - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #40 on Adoramapix.com by Herman KleinHerman Klein Aug 13, 2019 Desktop Product X.X% Progression

Herman Tested Pattern #85: Benefit Button On Adoramapix.com

 - Variant A
 - Variant B

In this experiment only the button label changed. The control had a more immediate (next step-oriented) button label of "Upload Your Photos Now". The variation tried a more benefit-oriented button of "Order Now" (hinting at paying and obtaining the product).

Total Sample: 13,454 Statistical Power at 5% MDE: 43.7%

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 Statistical Power at 5% MDE: 47.9%

Test #244 on Mt.com by Vito MediavillaVito Mediavilla Jun 06, 2019 Desktop Product X.X% Progression

Vito Tested Pattern #49: Above The Fold Call To Action On Mt.com

 - Variant A
 - Variant B

A product landing page with an image was tested against one without - raising the call to action above the fold.

Total Sample: 3,711 Statistical Power at 5% MDE: 11.2%

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

 - Variant A
 - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Total Sample: 25,046 Statistical Power at 5% MDE: 22.6%

Test #239 on Volders.de by Alexander KriegerAlexander Krieger May 02, 2019 Desktop Home & Landing X.X% Progression

Alexander Tested Pattern #13: Centered Forms & Buttons On Volders.de

 - Variant A
 - Variant B

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).

Total Sample: 1,288 Statistical Power at 5% MDE: 7.2%

Test #238 on Suzuki.be by Karl GilisKarl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

 - Variant A
 - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #231 on Glass.net by Mark FreedleMark Freedle Mar 14, 2019 Desktop Mobile Signup X.X% Progression

Mark Tested Pattern #20: Canned Response On Glass.net

 - Variant A
 - Variant B
Total Sample: 1,342 Statistical Power at 5% MDE: 6.4%

Test #226 on Microsoft.com by Ronny KohaviRonny Kohavi Feb 18, 2019 Desktop Product X.X% Progression

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

 - Variant A
 - Variant B

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 on by Devesh KhanalDevesh Khanal Feb 17, 2019 Desktop Product X.X% Progression

Devesh Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B
Total Sample: 53,908 Statistical Power at 5% MDE: 35.7%

Test #224 on by Alex JamesAlex James Feb 11, 2019 Desktop Home & Landing X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

 - Variant A
 - Variant B

This experiment reduced the search form by removing the distance field.

Total Sample: 97,074 Statistical Power at 5% MDE: 99.9%