All Latest 610 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #235 on Thomasnet.com by Julian Gaviria Apr 02, 2019 Desktop Mobile Home & Landing

Julian Tested Pattern #102: Expanded Or Condensed Layout On Thomasnet.com

In this experiment, the layout was condensed from a taller to a shorter one.

Test #234 on by Alex James Apr 01, 2019 Desktop Listing

Alex Tested Pattern #101: Search Keyword Highlighting

In this experiment, a different style for keyword highlighting was used.

Test #233 on Annonce.cz by Ondřej Ilinčev Apr 01, 2019 Desktop Signup

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email.

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Test #230 on Goodui.org by Jakub Linowski Mar 09, 2019 Desktop Mobile Listing

Jakub Tested Pattern #56: Hover Button On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #226 on Microsoft.com by Ronny Kohavi Feb 18, 2019 Desktop Product

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #225 on by Devesh Khanal Feb 17, 2019 Desktop Product

Devesh Tested Pattern #41: Sticky Call To Action

Test #223 on Volders.de by Alexander Krieger Feb 01, 2019 Desktop Mobile Signup

Alexander Tested Pattern #12: Payment First On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi Jan 27, 2019 Desktop Product

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James Jan 18, 2019 Desktop Listing

Alex Tested Pattern #34: Open In A New Tab

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #214 on Yummly.com by Marcos Ciarrocchi Dec 07, 2018 Mobile Signup

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup

Vito Tested Pattern #85: Benefit Button On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto Nov 12, 2018 Mobile Listing

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing