All Latest 650 A/B Tests

Test #227 on Volders.de by Alexander KriegerAlexander Krieger Mar 04, 2019 Desktop Signup X.X% Leads

Alexander Tested Pattern #99: Progress Bar On Volders.de

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows:

  1. Fill out the termination
  2. Send termination
  3. Proof of termination
Total Sample: 11,418 • Statistical Power at 5% MDE: 20.6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #222 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 01, 2019 Desktop Listing X.X% Leads

Julian Tested Pattern #7: Social Counts On Thomasnet.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this variation, a number of social proof references were added to a signup modal.
Total Sample: 34,676 • Statistical Power at 5% MDE: 47.1%

Test #223 on Volders.de by Alexander KriegerAlexander Krieger Feb 01, 2019 Desktop Mobile Signup X.X% Leads

Alexander Tested Pattern #12: Payment First On Volders.de

Pattern #12: Payment First - Variant A
Pattern #12: Payment First - Variant B

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Test #220 by Alex JamesAlex James Jan 18, 2019 Desktop Listing X.X% Leads

Alex Tested Pattern #34: Open In A New Tab

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).
Total Sample: 55,703 • Statistical Power at 5% MDE: 99.9%

Test #219 on Mt.com by Vito MediavillaVito Mediavilla Jan 14, 2019 Desktop Mobile Home & Landing X.X% Leads

Vito Tested Pattern #95: Clickable Product Previews On Mt.com

Pattern #95: Clickable Product Previews - Variant A
Pattern #95: Clickable Product Previews - Variant B
Total Sample: 4,836 • Statistical Power at 5% MDE: 11%

Test #215 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 21, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #92: Already Viewed Label On Vivareal.com.br

Pattern #92: Already Viewed Label - Variant A
Pattern #92: Already Viewed Label - Variant B

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.
Total Sample: 2,452,026 • Statistical Power at 5% MDE: 99.9%

Test #212 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Product X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a call to action was repeated at the bottom of the product page. Additional certification icons were also added for additional reassurance.
Total Sample: 26,467 • Statistical Power at 5% MDE: 9.7%

Test #213 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Leads

Vito Tested Pattern #85: Benefit Button On Mt.com

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In this variation, a longer button label with a clearer benefit was tested against a shorter one.
Total Sample: 26,639 • Statistical Power at 5% MDE: 12.8%

Test #209 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Nov 12, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.
Total Sample: 778,955 • Statistical Power at 5% MDE: 99.9%

Test #208 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this variation, the button labels were changed from "Profile" to "View Supplier".
Total Sample: 39,170 • Statistical Power at 5% MDE: 7.2%

Test #9 by Rick DawsonRick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

Pattern #83: Progressive Fields - Variant A
Pattern #83: Progressive Fields - Variant B
Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #200 on Trydesignlab.com by Will AndersonWill Anderson Sep 14, 2018 Desktop Mobile Home & Landing X.X% Leads

Will Tested Pattern #52: How It Works On Trydesignlab.com

Pattern #52: How It Works - Variant A
Pattern #52: How It Works - Variant B

In this experiment, a "How It Works" content section was removed.
Total Sample: 33,802 • Statistical Power at 5% MDE: 7.4%

Test #196 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Aug 14, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #80: Persistent Filters On Vivareal.com.br

Pattern #80: Persistent Filters - Variant A
Pattern #80: Persistent Filters - Variant B

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.
Total Sample: 441,738 • Statistical Power at 5% MDE: 99.9%

Test #185 on Retrome.pl by Grzegorz JancewiczGrzegorz Jancewicz Jul 03, 2018 Mobile Listing X.X% Leads

Grzegorz Tested Pattern #49: Above The Fold Call To Action On Retrome.pl

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 823 • Statistical Power at 5% MDE: 4%

Test #175 on Thomasnet.com by Julian GaviriaJulian Gaviria May 14, 2018 Desktop Mobile Content X.X% Leads

Julian Tested Pattern #23: Inline Link Nudge On Thomasnet.com

Pattern #23: Inline Link Nudge - Variant A
Pattern #23: Inline Link Nudge - Variant B
Total Sample: 67,295 • Statistical Power at 5% MDE: 3%

Test #172 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #171 on Sjvc.edu by Phillip BarnesPhillip Barnes Apr 27, 2018 Desktop Mobile Signup X.X% Leads

Phillip Tested Pattern #63: Trust Seals On Sjvc.edu

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B
Total Sample: 1,197 • Statistical Power at 5% MDE: 12.8%

Test #169 on Mt.com by Vito MediavillaVito Mediavilla Apr 24, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #37: List Or Grid View On Mt.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B
Total Sample: 5,934 • Statistical Power at 5% MDE: 4.5%

Test #168 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Apr 23, 2018 Desktop Listing X.X% Leads

Grzegorz Tested Pattern #45: Benefit Bar On Akademiafotografii.p...

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 4,302 • Statistical Power at 5% MDE: 5.5%

Test #156 on Mt.com by Vito MediavillaVito Mediavilla Feb 25, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).
Total Sample: 27,048 • Statistical Power at 5% MDE: 12.8%