Your filter results

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #247 on Thomasnet.com by Julian Gaviria   Jun 13, 2019 Desktop Mobile Content

Julian Gaviria Tested Pattern #41: Sticky Call To Action In Test #247 On Thomasnet.com

In this experiment, the same message (with a link) for signing up to a newsletter was shown in two distinct ways. The control (A) showed the signup message as inline one that preceded the content of the article at the very top. The variant showed the same signup message as a scroll-delayed sticky interaction at the bottom of the screen. The background color of the B variant was also inverted to match the style of the footer.

Test #246 on Thomasnet.com by Julian Gaviria   Jun 12, 2019 Desktop Mobile Home & Landing

Julian Gaviria Tested Pattern #88: Action Button In Test #246 On Thomasnet.com

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Test #245 on Kenhub.com by Niels Hapke   Jun 11, 2019 Desktop Signup

Niels Hapke Tested Pattern #19: Benefit Testimonials In Test #245 On Kenhub.com

In this experiment a more elaborate and authentic testimonial was used instead of three more generic ones from social media sites.

Test #244 on Mt.com by Vito Mediavilla   Jun 06, 2019 Desktop Product

Vito Mediavilla Tested Pattern #49: Above The Fold Call To Action In Test #244 On Mt.com

A product landing page with an image was tested against one without - raising the call to action above the fold.

Test #243 on Goodui.org by Jakub Linowski   Jun 05, 2019 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #77: Filled Or Ghost Buttons In Test #243 On Goodui.org

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Test #240 on Thomasnet.com by Julian Gaviria   May 16, 2019 Desktop Listing

Julian Gaviria Tested Pattern #13: Centered Forms & Buttons In Test #240 On Thomasnet.com

In this experiment, two different positions of the View Catalog button were compared. In version A the button was smaller and on the right. In version B the button was wider and more central. (The actual test was inverted before publishing to match the A-B of the pattern.)

Test #239 on Volders.de by Alexander Krieger   May 02, 2019 Desktop Home & Landing

Alexander Krieger Tested Pattern #13: Centered Forms & Buttons In Test #239 On Volders.de

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).

Test #238 on Suzuki.be by Karl Gilis   May 01, 2019 Desktop Home & Landing

Karl Gilis Tested Pattern #104: Carousel Vs Static Grid Images In Test #238 On Suzuki.be

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #236 on by Alex James   Apr 04, 2019 Desktop Signup

Alex James Tested Pattern #9: Multiple Steps In Test #236

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Test #235 on Thomasnet.com by Julian Gaviria   Apr 02, 2019 Desktop Mobile Home & Landing

Julian Gaviria Tested Pattern #102: Expanded Or Condensed Layout In Test #235 On Thomasnet.com

In this experiment, the layout was condensed from a taller to a shorter one.

Test #233 on Annonce.cz by Ondřej Ilinčev   Apr 01, 2019 Desktop Signup

Ondřej Ilinčev Tested Pattern #100: Postponed Registration In Test #233 On Annonce.cz

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email. 

 

Test #234 on by Alex James   Apr 01, 2019 Desktop Listing

Alex James Tested Pattern #101: Search Keyword Highlighting In Test #234

In this experiment, a different style for keyword highlighting was used.

Test #232 on Yoast.com by Sjardo Janssen   Mar 15, 2019 Desktop Mobile Checkout

Sjardo Janssen Tested Pattern #6: Customer Star Ratings In Test #232 On Yoast.com

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Test #230 on Goodui.org by Jakub Linowski   Mar 09, 2019 Desktop Mobile Listing

Jakub Linowski Tested Pattern #56: Hover Button In Test #230 On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #226 on Microsoft.com by Ronny Kohavi   Feb 18, 2019 Desktop Product

Ronny Kohavi Tested Pattern #96: Single Focus Photos In Test #226 On Microsoft.com

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #223 on Volders.de by Alexander Krieger   Feb 01, 2019 Desktop Mobile Signup

Alexander Krieger Tested Pattern #12: Payment First In Test #223 On Volders.de

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny Kohavi   Jan 27, 2019 Desktop Product

Ronny Kohavi Tested Pattern #49: Above The Fold Call To Action In Test #221 On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex James   Jan 18, 2019 Desktop Listing

Alex James Tested Pattern #34: Open In A New Tab In Test #220

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #214 on Yummly.com by Marcos Ciarrocchi   Dec 07, 2018 Mobile Signup

Marcos Ciarrocchi Tested Pattern #91: Forced Action In Test #214 On Yummly.com

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.