All Latest 650 A/B Tests

Test #262 on Thomasnet.com by Julian GaviriaJulian Gaviria Oct 03, 2019 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #32: Condensed List On Thomasnet.com

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

In this experiment, the B version condensed the company listings. This was done by showing less of the description and introducing a "more" and "less" dynamic links that would expand and collapse the description.
Total Sample: 105,732 • Statistical Power at 5% MDE: 8.6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Progression

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #40 on Adoramapix.com by Herman KleinHerman Klein Aug 13, 2019 Desktop Product X.X% Progression

Herman Tested Pattern #85: Benefit Button On Adoramapix.com

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In this experiment only the button label changed. The control had a more immediate (next step-oriented) button label of "Upload Your Photos Now". The variation tried a more benefit-oriented button of "Order Now" (hinting at paying and obtaining the product).
Total Sample: 13,454 • Statistical Power at 5% MDE: 43.7%

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.
Total Sample: 956,112 • Statistical Power at 5% MDE: 47.9%

Test #244 on Mt.com by Vito MediavillaVito Mediavilla Jun 06, 2019 Desktop Product X.X% Progression

Vito Tested Pattern #49: Above The Fold Call To Action On Mt.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

A product landing page with an image was tested against one without - raising the call to action above the fold.
Total Sample: 3,711 • Statistical Power at 5% MDE: 11.2%

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)
Total Sample: 25,046 • Statistical Power at 5% MDE: 22.6%

Test #239 on Volders.de by Alexander KriegerAlexander Krieger May 02, 2019 Desktop Home & Landing X.X% Progression

Alexander Tested Pattern #13: Centered Forms & Buttons On Volders.de

Pattern #13: Centered Forms & Buttons - Variant A
Pattern #13: Centered Forms & Buttons - Variant B

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).
Total Sample: 1,288 • Statistical Power at 5% MDE: 7.2%

Test #238 on Suzuki.be by Karl GilisKarl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

Pattern #104: Carousel Vs Static Grid Images - Variant A
Pattern #104: Carousel Vs Static Grid Images - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #231 on Glass.net by Mark FreedleMark Freedle Mar 14, 2019 Desktop Mobile Signup X.X% Progression

Mark Tested Pattern #20: Canned Response On Glass.net

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B
Total Sample: 1,342 • Statistical Power at 5% MDE: 6.4%

Test #226 on Microsoft.com by Ronny KohaviRonny Kohavi Feb 18, 2019 Desktop Product X.X% Progression

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

Pattern #96: Single Focus Photos - Variant A
Pattern #96: Single Focus Photos - Variant B

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 by Devesh KhanalDevesh Khanal Feb 17, 2019 Desktop Product X.X% Progression

Devesh Tested Pattern #41: Sticky Call To Action

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B
Total Sample: 53,908 • Statistical Power at 5% MDE: 35.7%

Test #224 by Alex JamesAlex James Feb 11, 2019 Desktop Home & Landing X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

This experiment reduced the search form by removing the distance field.
Total Sample: 97,074 • Statistical Power at 5% MDE: 99.9%

Test #222 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 01, 2019 Desktop Listing X.X% Progression

Julian Tested Pattern #7: Social Counts On Thomasnet.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this variation, a number of social proof references were added to a signup modal.
Total Sample: 34,676 • Statistical Power at 5% MDE: 47.1%

Test #221 on Microsoft.com by Ronny KohaviRonny Kohavi Jan 27, 2019 Desktop Product X.X% Progression

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #216 on Support.microsoft.co... by Ronny KohaviRonny Kohavi Dec 21, 2018 Desktop Home & Landing X.X% Progression

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Progression

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.
Total Sample: 26,467 • Statistical Power at 5% MDE: 9.7%

Test #213 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Progression

Vito Tested Pattern #85: Benefit Button On Mt.com

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In this variation, a longer button label with a clearer benefit was tested against a shorter one.
Total Sample: 26,639 • Statistical Power at 5% MDE: 12.8%

Test #211 on Skype App by Ronny KohaviRonny Kohavi Nov 20, 2018 Mobile Global X.X% Progression

Ronny Tested Pattern #2: Icon Labels

Pattern #2: Icon Labels - Variant A
Pattern #2: Icon Labels - Variant B

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #208 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this variation, the button labels were changed from "Profile" to "View Supplier".
Total Sample: 39,170 • Statistical Power at 5% MDE: 7.2%

Test #207 on Suzuki.be by Karl GilisKarl Gilis Nov 01, 2018 Desktop Product X.X% Progression

Karl Tested Pattern #88: Action Button On Suzuki.be

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

This test ran on the Suzuki Swift landing page. In the B variation, extra links with the following copy ‘Discover the <name of car model>’ were added for each sub product. (in Dutch: ‘Bekijk de…’).