The Latest A/B Tests


These are the amazing companies we work with that are actively sharing quality a/b test results.


MOST RECENT TESTS

Test #227 on Volders.de by Alexander Krieger | Mar 04, 2019

Alexander Krieger Tested Pattern #99: Progress Bar In Test #227 On Volders.de

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows:

  1. Fill out the termination
  2. Send termination
  3. Proof of termination

Test #226 on Microsoft.com by Ronny Kohavi | Feb 18, 2019

Ronny Kohavi Tested Pattern #96: Single Focus Photos In Test #226 On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #224 on by Alex James | Feb 11, 2019 Desktop

Alex James Tested Pattern #3: Fewer Form Fields In Test #224

This experiment reduced the search form by removing the distance field.

Test #223 on Volders.de by Alexander Krieger | Feb 01, 2019 Desktop Mobile

Alexander Krieger Tested Pattern #12: Payment First In Test #223 On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi | Jan 27, 2019

Ronny Kohavi Tested Pattern #49: Above The Fold Call To Action In Test #221 On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James | Jan 18, 2019 Desktop

Alex James Tested Pattern #34: Open In A New Tab In Test #220

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #218 on Yummly.com by Kimberly Cheung | Jan 14, 2019 Desktop Mobile

Kimberly Cheung Tested Pattern #94: Visible Search In Test #218 On Yummly.com

Hypothesis: Anonymous users can't use global search while on the home promo page. We believe that if we show a global search bar to anonymous users, it presents a higher converting funnel (guided search) and will increase our sign-up rates significantly.

Control (A): Logged out users don't see global search bar.

Variant (B): Logged out users see global search bar. After searching for a keyword, the signup funnel starts with a more personalized reason to continue the signup process.

Test #216 on Support.microsoft.co... by Ronny Kohavi | Dec 21, 2018 Desktop

Ronny Kohavi Tested Pattern #2: Icon Labels In Test #216 On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto | Dec 21, 2018 Mobile

Vinicius Barros Peixoto Tested Pattern #92: Already Viewed Label In Test #215 On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #214 on Yummly.com by Marcos Ciarrocchi | Dec 07, 2018 Mobile

Marcos Ciarrocchi Tested Pattern #91: Forced Action In Test #214 On Yummly.com

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #212 on Mt.com by Vito Mediavilla | Dec 04, 2018 Desktop Mobile

Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #212 On Mt.com

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.

Test #211 on Skype App by Ronny Kohavi | Nov 20, 2018 Mobile

Ronny Kohavi Tested Pattern #2: Icon Labels In Test #211

Microsoft Skype ran an experiment for the mobile segment of the Skype application with a treatment having combined icons with corresponding labels. The control only showed icons.

Test #210 on Bomgar.com by Lee Elkins | Nov 13, 2018 Desktop Mobile

Lee Elkins Tested Pattern #64: Tunnel In Test #210 On Bomgar.com