All Latest 644 A/B Tests

MOST RECENT TESTS

Test #388 by Jakub LinowskiJakub Linowski Dec 09, 2021 Mobile Listing X.X% Sales

Jakub Tested Pattern #51: Shortcut Buttons

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this experiment, extra "buy now" buttons were added on a listing page. These buttons were shortcuts to an add to cart flow, whereas the "learn more" buttons lead customers to product detail pages (visible in both control and variation). Impact on adds-to-cart and sales was measured.
Total Sample: 7,051 • Statistical Power at 5% MDE: 10.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #378 by Jakub LinowskiJakub Linowski Oct 07, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

Pattern #119: Unselected Or Selected Defaults - Variant A
Pattern #119: Unselected Or Selected Defaults - Variant B

Here we have an experiment with a variation that preselected an option for a club duration. The control required customers to first express the choice for how many months they would like to order a product for. Whereas the variation defaulted to 12 months from the beginning.

Impact on adds-to-cart and sales was measured. The experiment unfortunately had to be stopped early due to another embedded variation that was performing poorly. And so it does not have many transactions.
Total Sample: 2,953 • Statistical Power at 5% MDE: 5.2%

Test #374 on Expertinstitute.com by Ardit VeliuArdit Veliu Sep 15, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #9: Multiple Steps On Expertinstitute.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a lead form with numerous fields shown all at once, was broken down into 3 steps. The first step only asked for a Specialty choice that expanded into a list of options. Impact on full form completions was measured.
Total Sample: 5,628 • Statistical Power at 5% MDE: 7.5%

Test #366 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

Pattern #93: Auto Next - Variant A
Pattern #93: Auto Next - Variant B

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.
Total Sample: 80,881 • Statistical Power at 5% MDE: 95%

Test #351 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Apr 30, 2021 Desktop Mobile Home & Landing X.X% Signups

Brian Tested Pattern #11: Gradual Reassurance On Baremetrics.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, static integration logos were replaced with selectable ones that reassured users to signup. After clicking an integration logo, a comparison chart would appear showing how Baremetrics improves upon a selected payment processor, along with a call to signup. Impact on signups was measured.
Total Sample: 24,416 • Statistical Power at 5% MDE: 7%

Test #333 on Expertinstitute.com by Ardit VeliuArdit Veliu Dec 31, 2020 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #11: Gradual Reassurance On Expertinstitute.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, the variation broke up a lead form into two parts. In the first step users were asked for their state followed by a standard contact form on a second step. All of the states were shown as selectable options. In the control version, the landing page only showed a button which lead to the full form. The experiment measured impact on lead form submissions.
Total Sample: 11,258 • Statistical Power at 5% MDE: 6.1%

Test #313 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Aug 19, 2020 Desktop Mobile Home & Landing X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, instead of showing a single-focused lead form (for the UX Academy Program), users were asked to express a wider set of choices first (for the UX Academy or shortter set of skill-based courses). The experiment measured overall leads for both types of programs.
Total Sample: 13,231 • Statistical Power at 5% MDE: 15.7%

Test #39 on Over-blog.com by Tael PinaultTael Pinault Jul 02, 2019 Desktop Signup X.X% Signups

Tael Tested Pattern #83: Progressive Fields On Over-blog.com

Pattern #83: Progressive Fields - Variant A
Pattern #83: Progressive Fields - Variant B

This test explored a progressive disclosure interaction in variation B. When a user started typing text into the first field, two more fields expanded into view.
Total Sample: 10,464 • Statistical Power at 5% MDE: 37.8%

Test #172 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #131 on Kenhub.com by Niels HapkeNiels Hapke Dec 11, 2017 Desktop Home & Landing X.X% Signups

Niels Tested Pattern #11: Gradual Reassurance On Kenhub.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 121,291 • Statistical Power at 5% MDE: 98.8%

Test #93 on Examine.com by Martin WongMartin Wong Aug 01, 2017 Desktop Home & Landing X.X% Sales

Martin Tested Pattern #29: Surfaced Content On Examine.com

Pattern #29: Surfaced Content - Variant A
Pattern #29: Surfaced Content - Variant B
Total Sample: 102,416 • Statistical Power at 5% MDE: 6.1%

Test #103 on Rollbar.com by Mike SmithMike Smith May 01, 2017 Desktop Home & Landing X.X% Signups

Mike Tested Pattern #11: Gradual Reassurance On Rollbar.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 20,877 • Statistical Power at 5% MDE: 11.4%

Test #46 on Hylokusa.com by Julian GaviriaJulian Gaviria Feb 01, 2017 Desktop Product X.X% Progression

Julian Tested Pattern #60: Repeated Bottom Call To Action On Hylokusa.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B
Total Sample: 1,416 • Statistical Power at 5% MDE: 4.5%

Test #94 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Feb 01, 2017 Mobile Desktop Signup X.X% Signups

Rodrigo Tested Pattern #14: Exposed Menu Options On Vivareal.com.br

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B
Total Sample: 20,709 • Statistical Power at 5% MDE: 63.7%

Test #76 on Goodui.org by Jakub LinowskiJakub Linowski Feb 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #16: Welcome Mat - Partial On Goodui.org

Pattern #16: Welcome Mat - Partial - Variant A
Pattern #16: Welcome Mat - Partial - Variant B
Total Sample: 11,330 • Statistical Power at 5% MDE: 5.9%

Test #82 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 17, 2017 Desktop Mobile Home & Landing X.X% Signups

Pierre Olivier Tested Pattern #10: Postponed Modal Forms On Poll-app.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B
Total Sample: 21,762 • Statistical Power at 5% MDE: 80.4%

Test #64 on Goodui.org by Jakub LinowskiJakub Linowski Jan 01, 2017 Desktop Home & Landing X.X% Signups

Jakub Tested Pattern #41: Sticky Call To Action On Goodui.org

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, we showed a sticky navigation bar with 5 actions such as (newsletter signup, and visiting certain landing pages). Upon completion of each task, the navigation would transform into a completed state while using cookies to store it for future reference.
Total Sample: 35,058 • Statistical Power at 5% MDE: 11.2%

Test #91 on 3dhubs.com by Rob DraaijerRob Draaijer Jan 01, 2017 Desktop Listing X.X% Leads

Rob Tested Pattern #9: Multiple Steps On 3dhubs.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a long form with multiple steps was broken down into a progressive interaction form. In the B variant, as users would complete particular steps, new ones would be communicated subtly and finally come into full view.
Total Sample: 54,916 • Statistical Power at 5% MDE: 54.3%

Test #69 on Digitalmarketer.com by Justin RondeauJustin Rondeau Aug 01, 2016 Desktop Mobile Home & Landing X.X% Signups

Justin Tested Pattern #10: Postponed Modal Forms On Digitalmarketer.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B
Total Sample: 2,685 • Statistical Power at 5% MDE: 20%

Test #57 by Jakub LinowskiJakub Linowski Jul 07, 2016 Desktop Checkout X.X% Sales

Jakub Tested Pattern #66: Complementary Upsell

Pattern #66: Complementary Upsell - Variant A
Pattern #66: Complementary Upsell - Variant B
Total Sample: 6,079 • Statistical Power at 5% MDE: 12.5%