All Latest 639 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #366 on Mvideo.ru by Andrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.

Total Sample: 80,881 • Statistical Power at 5% MDE: 95%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #351 on Baremetrics.com by Brian Sierakowski Apr 30, 2021 Desktop Mobile Home & Landing X.X% Signups

Brian Tested Pattern #11: Gradual Reassurance On Baremetrics.com

In this experiment, static integration logos were replaced with selectable ones that reassured users to signup. After clicking an integration logo, a comparison chart would appear showing how Baremetrics improves upon a selected payment processor, along with a call to signup. Impact on signups was measured.

Total Sample: 24,416 • Statistical Power at 5% MDE: 7%

Test #333 on Expertinstitute.com by Ardit Veliu Dec 31, 2020 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #11: Gradual Reassurance On Expertinstitute.com

In this experiment, the variation broke up a lead form into two parts. In the first step users were asked for their state followed by a standard contact form on a second step. All of the states were shown as selectable options. In the control version, the landing page only showed a button which lead to the full form. The experiment measured impact on lead form submissions.

Total Sample: 11,258 • Statistical Power at 5% MDE: 6.1%

Test #313 on Trydesignlab.com by Daniel Shapiro Aug 19, 2020 Desktop Mobile Home & Landing X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

In this experiment, instead of showing a single-focused lead form (for the UX Academy Program), users were asked to express a wider set of choices first (for the UX Academy or shortter set of skill-based courses). The experiment measured overall leads for both types of programs.

Total Sample: 13,231 • Statistical Power at 5% MDE: 15.7%

Test #39 on Over-blog.com by Tael Pinault Jul 02, 2019 Desktop Signup X.X% Signups

Tael Tested Pattern #83: Progressive Fields On Over-blog.com

This test explored a progressive disclosure interaction in variation B. When a user started typing text into the first field, two more fields expanded into view.

Total Sample: 10,464 • Statistical Power at 5% MDE: 37.8%

Test #172 on Trydesignlab.com by Daniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #131 on Kenhub.com by Niels Hapke Dec 11, 2017 Desktop Home & Landing X.X% Signups

Niels Tested Pattern #11: Gradual Reassurance On Kenhub.com

Total Sample: 121,291 • Statistical Power at 5% MDE: 98.8%

Test #93 on Examine.com by Martin Wong Aug 01, 2017 Desktop Home & Landing X.X% Sales

Martin Tested Pattern #29: Surfaced Content On Examine.com

Total Sample: 102,416 • Statistical Power at 5% MDE: 6.1%

Test #103 on Rollbar.com by Mike Smith May 01, 2017 Desktop Home & Landing X.X% Signups

Mike Tested Pattern #11: Gradual Reassurance On Rollbar.com

Total Sample: 20,877 • Statistical Power at 5% MDE: 11.4%

Test #76 on Goodui.org by Jakub Linowski Feb 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #16: Welcome Mat - Partial On Goodui.org

Total Sample: 11,330 • Statistical Power at 5% MDE: 5.9%

Test #46 on Hylokusa.com by Julian Gaviria Feb 01, 2017 Desktop Product X.X% Progression

Julian Tested Pattern #60: Repeated Bottom Call To Action On Hylokusa.com

Total Sample: 1,416 • Statistical Power at 5% MDE: 4.5%

Test #94 on Vivareal.com.br by Rodrigo Maués Feb 01, 2017 Mobile Desktop Signup X.X% Signups

Rodrigo Tested Pattern #14: Exposed Menu Options On Vivareal.com.br

Total Sample: 20,709 • Statistical Power at 5% MDE: 63.7%

Test #82 on Poll-app.com by Pierre Olivier Martel Jan 17, 2017 Desktop Mobile Home & Landing X.X% Signups

Pierre Olivier Tested Pattern #10: Postponed Modal Forms On Poll-app.com

Total Sample: 21,762 • Statistical Power at 5% MDE: 80.4%

Test #64 on Goodui.org by Jakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.

Total Sample: 35,058 • Statistical Power at 5% MDE: 11.2%

Test #91 on 3dhubs.com by Rob Draaijer Jan 01, 2017 Desktop Listing X.X% Leads

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.

Total Sample: 54,916 • Statistical Power at 5% MDE: 54.3%

Test #69 on Digitalmarketer.com by Justin Rondeau Aug 01, 2016 Desktop Mobile Home & Landing X.X% Signups