Your filter results

Screen

Device

Metric

Tag

Only Significant A/B Tests

Only show the highest quality tests with a p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #234 on by Alex James Apr 01, 2019 Desktop Listing

Alex James Tested Pattern #101: Search Keyword Highlighting In Test #234

In this experiment, a different style for keyword highlighting was used.

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout

Sjardo Janssen Tested Pattern #6: Customer Star Ratings In Test #232 On Yoast.com

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Test #230 on Goodui.org by Jakub Linowski Mar 09, 2019 Desktop Mobile Listing

Jakub Linowski Tested Pattern #56: Hover Button In Test #230 On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #226 on Microsoft.com by Ronny Kohavi Feb 18, 2019 Desktop Product

Ronny Kohavi Tested Pattern #96: Single Focus Photos In Test #226 On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 on by Devesh Khanal Feb 17, 2019 Desktop Product

Devesh Khanal Tested Pattern #41: Sticky Call To Action In Test #225

Test #223 on Volders.de by Alexander Krieger Feb 01, 2019 Desktop Mobile Signup

Alexander Krieger Tested Pattern #12: Payment First In Test #223 On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi Jan 27, 2019 Desktop Product

Ronny Kohavi Tested Pattern #49: Above The Fold Call To Action In Test #221 On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James Jan 18, 2019 Desktop Listing

Alex James Tested Pattern #34: Open In A New Tab In Test #220

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #214 on Yummly.com by Marcos Ciarrocchi Dec 07, 2018 Mobile Signup

Marcos Ciarrocchi Tested Pattern #91: Forced Action In Test #214 On Yummly.com

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup

Vito Mediavilla Tested Pattern #85: Benefit Button In Test #213 On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto Nov 12, 2018 Mobile Listing

Vinicius Barros Peixoto Tested Pattern #34: Open In A New Tab In Test #209 On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing