All Latest 620 A/B Tests

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

 - Variant A
 - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #240 on Thomasnet.com by Julian GaviriaJulian Gaviria May 16, 2019 Desktop Listing X.X% Engagement

Julian Tested Pattern #13: Centered Forms & Buttons On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, two different positions of the View Catalog button were compared. In version A the button was smaller and on the right. In version B the button was wider and more central. (The actual test was inverted before publishing to match the A-B of the pattern.)

Test #239 on Volders.de by Alexander KriegerAlexander Krieger May 02, 2019 Desktop Home & Landing X.X% Progression

Alexander Tested Pattern #13: Centered Forms & Buttons On Volders.de

 - Variant A
 - Variant B

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).

Test #238 on Suzuki.be by Karl GilisKarl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

 - Variant A
 - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #236 on by Alex JamesAlex James Apr 04, 2019 Desktop Signup X.X% Signups

Alex Tested Pattern #9: Multiple Steps

 - Variant A
 - Variant B

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Test #235 on Thomasnet.com by Julian GaviriaJulian Gaviria Apr 02, 2019 Desktop Mobile Home & Landing X.X% Leads

Julian Tested Pattern #102: Expanded Or Condensed Layout On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the layout was condensed from a taller to a shorter one.

Test #233 on Annonce.cz by Ondřej IlinčevOndřej Ilinčev Apr 01, 2019 Desktop Signup X.X% Sales

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

 - Variant A
 - Variant B

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email. 

 

Test #234 on by Alex JamesAlex James Apr 01, 2019 Desktop Listing X.X% Leads

Alex Tested Pattern #101: Search Keyword Highlighting

 - Variant A
 - Variant B

In this experiment, a different style for keyword highlighting was used.

Test #232 on Yoast.com by Sjardo JanssenSjardo Janssen Mar 15, 2019 Desktop Mobile Checkout X.X% Sales

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

 - Variant A
 - Variant B

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Test #230 on Goodui.org by Jakub LinowskiJakub Linowski Mar 09, 2019 Desktop Mobile Listing X.X% Engagement

Jakub Tested Pattern #56: Hover Button On Goodui.org

 - Variant A
 - Variant B

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #226 on Microsoft.com by Ronny KohaviRonny Kohavi Feb 18, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

 - Variant A
 - Variant B

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #223 on Volders.de by Alexander KriegerAlexander Krieger Feb 01, 2019 Desktop Mobile Signup X.X% Revenue

Alexander Tested Pattern #12: Payment First On Volders.de

 - Variant A
 - Variant B

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #221 on Microsoft.com by Ronny KohaviRonny Kohavi Jan 27, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

 - Variant A
 - Variant B

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex JamesAlex James Jan 18, 2019 Desktop Listing X.X% Leads

Alex Tested Pattern #34: Open In A New Tab

 - Variant A
 - Variant B

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #214 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi Dec 07, 2018 Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

 - Variant A
 - Variant B

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #213 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Leads

Vito Tested Pattern #85: Benefit Button On Mt.com

 - Variant A
 - Variant B

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Test #209 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Nov 12, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

 - Variant A
 - Variant B

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #208 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #88: Action Button On Thomasnet.com

 - Variant A
 - Variant B

In this variation, the button labels were changed from "Profile" to "View Supplier".