All Latest 608 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #227 on Volders.de by Alexander Krieger Mar 04, 2019 Desktop Signup

Alexander Tested Pattern #99: Progress Bar On Volders.de

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows:

Fill out the termination
Send termination
Proof of termination

Test #226 on Microsoft.com by Ronny Kohavi Feb 18, 2019 Desktop Product

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 on by Devesh Khanal Feb 17, 2019 Desktop Product

Devesh Tested Pattern #41: Sticky Call To Action

Test #224 on by Alex James Feb 11, 2019 Desktop Home & Landing

Alex Tested Pattern #3: Fewer Form Fields

This experiment reduced the search form by removing the distance field.

Test #222 on Thomasnet.com by Julian Gaviria Feb 01, 2019 Desktop Listing

Julian Tested Pattern #7: Social Counts On Thomasnet.com

In this variation, a number of social proof references were added to a signup modal.

Test #223 on Volders.de by Alexander Krieger Feb 01, 2019 Desktop Mobile Signup

Alexander Tested Pattern #12: Payment First On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi Jan 27, 2019 Desktop Product

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James Jan 18, 2019 Desktop Listing

Alex Tested Pattern #34: Open In A New Tab

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #218 on Yummly.com by Kimberly Cheung Jan 14, 2019 Desktop Mobile Home & Landing

Kimberly Tested Pattern #94: Visible Search On Yummly.com

Hypothesis: Anonymous users can't use global search while on the home promo page. We believe that if we show a global search bar to anonymous users, it presents a higher converting funnel (guided search) and will increase our sign-up rates significantly.

Control (A): Logged out users don't see global search bar.

Variant (B): Logged out users see global search bar. After searching for a keyword, the signup funnel starts with a more personalized reason to continue the signup process.

Test #219 on Mt.com by Vito Mediavilla Jan 14, 2019 Desktop Mobile Home & Landing

Vito Tested Pattern #95: Clickable Product Previews On Mt.com

Test #217 on Thomasnet.com by Julian Gaviria Jan 03, 2019 Desktop Mobile Home & Landing

Julian Tested Pattern #41: Sticky Call To Action On Thomasnet.com

Test #216 on Support.microsoft.co... by Ronny Kohavi Dec 21, 2018 Desktop Home & Landing

Ronny Tested Pattern #2: Icon Labels On Support.microsoft.co...

Microsoft ran an experiment on their Customer Satisfaction Survey at both support.microsoft.com and answers.microsoft.com (Desktop). The treatment contained two icon labels at the opposite sides of the star rating range (ex: Very Dissatisfied and Very Satisfied) - providing it with additional meaning.

Test #212 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Product