All Latest 633 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #230 on Goodui.org by Jakub Linowski Mar 09, 2019 Desktop Mobile Listing X.X% Engagement

Jakub Tested Pattern #56: Hover Button On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Total Sample: 30,699 • Statistical Power at 5% MDE: 98.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #221 on Microsoft.com by Ronny Kohavi Jan 27, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #213 on Mt.com by Vito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Leads

Vito Tested Pattern #85: Benefit Button On Mt.com

In this variation, a longer button label with a clearer benefit was tested against a shorter one.

Total Sample: 26,639 • Statistical Power at 5% MDE: 12.8%

Test #208 on Thomasnet.com by Julian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #88: Action Button On Thomasnet.com

In this variation, the button labels were changed from "Profile" to "View Supplier".

Total Sample: 39,170 • Statistical Power at 5% MDE: 7.2%

Test #203 on Driving-tests.org by Andrei Zakhareuski Oct 10, 2018 Desktop Global X.X% Sales

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".

Total Sample: 67,451 • Statistical Power at 5% MDE: 3.9%

Test #199 on Freshegg.co.uk by Luke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #188 on Thomasnet.com by Julian Gaviria Jul 11, 2018 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #4: Testimonials On Thomasnet.com

In this experiment, a testimonial with a repeated call to action was placed at the bottom of a landing page.

Total Sample: 3,945 • Statistical Power at 5% MDE: 8.7%

Test #185 on Retrome.pl by Grzegorz Jancewicz Jul 03, 2018 Mobile Listing X.X% Leads

Grzegorz Tested Pattern #49: Above The Fold Call To Action On Retrome.pl

Total Sample: 823 • Statistical Power at 5% MDE: 4%

Test #186 on by Devesh Khanal Jul 02, 2018 Mobile Home & Landing X.X% Sales

Devesh Tested Pattern #14: Exposed Menu Options

In this experiment, additional product categories were added at the top of the navigation.

Total Sample: 76,974 • Statistical Power at 5% MDE: 41.4%

Test #170 on Goodui.org by Jakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #160 on Examine.com by Martin Wong Mar 15, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Test #156 on Mt.com by Vito Mediavilla Feb 25, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).

Total Sample: 27,048 • Statistical Power at 5% MDE: 12.8%

Test #149 on Reverb.com by Nicholas Evans Feb 07, 2018 Desktop Product X.X% Signups

Nicholas Tested Pattern #16: Welcome Mat - Partial On Reverb.com

Total Sample: 726,088 • Statistical Power at 5% MDE: 17.2%

Test #143 on Vivareal.com.br by Rodrigo Maués Jan 14, 2018 Desktop Listing X.X% Leads

Rodrigo Tested Pattern #56: Hover Button On Vivareal.com.br

Total Sample: 2,594,182 • Statistical Power at 5% MDE: 99.9%

Test #141 on Trydesignlab.com by Daniel Shapiro Jan 05, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #49: Above The Fold Call To Action On Trydesignlab.com

The variation introduced a call to action at the top of the screen that linked to a form deep down on a long course page.

Total Sample: 5,789 • Statistical Power at 5% MDE: 6.4%

Test #139 on Examine.com by Martin Wong Jan 04, 2018 Desktop Pricing X.X% Sales

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.

Total Sample: 18,620 • Statistical Power at 5% MDE: 7.6%

Test #134 on Kenhub.com by Niels Hapke Dec 14, 2017 Desktop Product X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.

Total Sample: 29,743 • Statistical Power at 5% MDE: 13.5%

Test #132 on Sjvc.edu by Phillip Barnes Dec 12, 2017 Mobile Home & Landing X.X% Leads