All Latest 633 A/B Tests

Test #223 on Volders.de by Alexander KriegerAlexander Krieger Feb 01, 2019 Desktop Mobile Signup X.X% Revenue

Alexander Tested Pattern #12: Payment First On Volders.de

- Variant A
- Variant B

This test deprioritized the free option (kostenlos) of cancelling a contract. It did so by placing it under the paid options as small text link / radio option.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #221 on Microsoft.com by Ronny KohaviRonny Kohavi Jan 27, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

- Variant A
- Variant B

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #220 on by Alex JamesAlex James Jan 18, 2019 Desktop Listing X.X% Leads

Alex Tested Pattern #34: Open In A New Tab

- Variant A
- Variant B

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).
Total Sample: 55,703 • Statistical Power at 5% MDE: 99.9%

Test #214 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi Dec 07, 2018 Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

- Variant A
- Variant B

In this experiment, the highly prominent "skip" button was replaced with a less prominent text link. The copy of the skip text link also clarified the consequence of the action - losing out on personalization benefits. More so, the habitual top-right cancel icon was also removed.

Test #213 on Mt.com by Vito MediavillaVito Mediavilla Dec 04, 2018 Desktop Mobile Signup X.X% Leads

Vito Tested Pattern #85: Benefit Button On Mt.com

- Variant A
- Variant B

In this variation, a longer button label with a clearer benefit was tested against a shorter one.
Total Sample: 26,639 • Statistical Power at 5% MDE: 12.8%

Test #209 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Nov 12, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

- Variant A
- Variant B

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.
Total Sample: 778,955 • Statistical Power at 5% MDE: 99.9%

Test #208 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 02, 2018 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #88: Action Button On Thomasnet.com

- Variant A
- Variant B

In this variation, the button labels were changed from "Profile" to "View Supplier".
Total Sample: 39,170 • Statistical Power at 5% MDE: 7.2%

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

- Variant A
- Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #205 on Msn.com by Ronny KohaviRonny Kohavi Oct 25, 2018 Desktop Home & Landing X.X% Engagement

Ronny Tested Pattern #36: Fewer Or More Results On Msn.com

- Variant A
- Variant B

In this experiment, the carousel items were increased from 12 to 16.

Test #206 on Yummly.com by Kimberly CheungKimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

- Variant A
- Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.
Total Sample: 138,106 • Statistical Power at 5% MDE: 77.4%

Test #204 on Kenhub.com by Niels HapkeNiels Hapke Oct 11, 2018 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #85: Benefit Button On Kenhub.com

- Variant A
- Variant B

In the variation, the "Help" section was reworded to "How to study".
Total Sample: 171,904 • Statistical Power at 5% MDE: 8.5%

Test #203 on Driving-tests.org by Andrei ZakhareuskiAndrei Zakhareuski Oct 10, 2018 Desktop Global X.X% Sales

Andrei Tested Pattern #85: Benefit Button On Driving-tests.org

- Variant A
- Variant B

In the variation, the button label "Upgrade To Premium" was changed to one with a clearer benefit of "Pass The First Time".
Total Sample: 67,451 • Statistical Power at 5% MDE: 3.9%

Test #202 on Kenhub.com by Niels HapkeNiels Hapke Oct 01, 2018 Desktop Mobile Checkout X.X% Sales

Niels Tested Pattern #13: Centered Forms & Buttons On Kenhub.com

- Variant A
- Variant B

In this experiment, the form layout was adjusted by shifting the side benefits further down below the form.
Total Sample: 2,884 • Statistical Power at 5% MDE: 49.4%

Test #9 on by Rick DawsonRick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

- Variant A
- Variant B
Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #199 on Freshegg.co.uk by Luke HayLuke Hay Sep 13, 2018 Desktop Mobile Home & Landing X.X% Progression

Luke Tested Pattern #77: Filled Or Ghost Buttons On Freshegg.co.uk

- Variant A
- Variant B

In this experiment, standard (filled) buttons were tested against ghost buttons.

Test #198 on Bomgar.com by Lee ElkinsLee Elkins Sep 03, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #40: Blurred Product Background On Bomgar.com

- Variant A
- Variant B
Total Sample: 1,893 • Statistical Power at 5% MDE: 21.3%

Test #196 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Aug 14, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #80: Persistent Filters On Vivareal.com.br

- Variant A
- Variant B

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.
Total Sample: 441,738 • Statistical Power at 5% MDE: 99.9%

Test #194 on Bomgar.com by Lee ElkinsLee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

- Variant A
- Variant B
Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #190 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

- Variant A
- Variant B

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.
Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep LajaPeep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

- Variant A
- Variant B
Total Sample: 96,195 • Statistical Power at 5% MDE: 48.2%