All Latest 539 A/B Tests

Only Significant A/B Tests
Join To See The Highest Impact Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #170 on Goodui.org by Jakub Linowski   Apr 24, 2018 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #49: Above The Fold Call To Action In Test #170 On Goodui.org

Test #166 on Olark.com by Sunir Shah   Apr 05, 2018 Desktop Mobile Home & Landing

Sunir Shah Tested Pattern #12: Payment First In Test #166 On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Test #164 on Examine.com by Martin Wong   Apr 04, 2018 Desktop Mobile Thank You

Martin Wong Tested Pattern #50: Autoplay Video In Test #164 On Examine.com

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Test #163 on Lovehoney.co.uk by Matthew Curry   Mar 27, 2018 Mobile Desktop Product

Matthew Curry Tested Pattern #62: Urgent Next Day Delivery In Test #163 On Lovehoney.co.uk

Test #161 on Examine.com by Martin Wong   Mar 19, 2018 Desktop Mobile Home & Landing

Martin Wong Tested Pattern #22: Empowering Headline In Test #161 On Examine.com

Test #160 on Examine.com by Martin Wong   Mar 15, 2018 Desktop Mobile Product

Martin Wong Tested Pattern #49: Above The Fold Call To Action In Test #160 On Examine.com

Test #158 on Kenhub.com by Niels Hapke   Mar 11, 2018 Desktop Mobile Checkout

Niels Hapke Tested Pattern #63: Trust Seals In Test #158 On Kenhub.com

Test #155 on Mt.com by Vito Mediavilla   Feb 22, 2018 Mobile Product

Vito Mediavilla Tested Pattern #3: Fewer Form Fields In Test #155 On Mt.com

Test #154 on Reverb.com by Nicholas Evans   Feb 20, 2018 Desktop Mobile Product

Nicholas Evans Tested Pattern #59: Inverted Or Consistent Button Styles In Test #154 On Reverb.com

Test #153 on Goodui.org by Jakub Linowski   Feb 19, 2018 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #58: Full Height False Bottom In Test #153 On Goodui.org

Test #152 on Reverb.com by Nicholas Evans   Feb 13, 2018 Desktop Mobile Product

Nicholas Evans Tested Pattern #15: Bulleted Reassurances In Test #152 On Reverb.com

Test #148 on Kenhub.com by Niels Hapke   Feb 01, 2018 Desktop Mobile Home & Landing

Niels Hapke Tested Pattern #53: Problem-Solution Headline In Test #148 On Kenhub.com

Test #146 on Goodui.org by Jakub Linowski   Jan 25, 2018 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #49: Above The Fold Call To Action In Test #146 On Goodui.org

Test #147 on Reverb.com by Nicholas Evans   Jan 25, 2018 Desktop Mobile Product

Nicholas Evans Tested Pattern #20: Canned Response In Test #147 On Reverb.com

Test #144 on Examine.com by Martin Wong   Jan 14, 2018 Desktop Mobile Product

Martin Wong Tested Pattern #27: More For Less Headline In Test #144 On Examine.com

Test #140 on Akademiafotografii.p... by Grzegorz Jancewicz   Jan 05, 2018 Desktop Mobile Product

Grzegorz Jancewicz Tested Pattern #46: Pay Later In Test #140 On Akademiafotografii.p...

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".

Test #141 on Trydesignlab.com by Daniel Shapiro   Jan 05, 2018 Desktop Mobile Product

Daniel Shapiro Tested Pattern #49: Above The Fold Call To Action In Test #141 On Trydesignlab.com

The variation introduced a call to action at the top of the screen that linked to a form deep down on a long course page.

Test #137 on Trydesignlab.com by Daniel Shapiro   Dec 22, 2017 Desktop Mobile Checkout

Daniel Shapiro Tested Pattern #46: Pay Later In Test #137 On Trydesignlab.com

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #138 on Trydesignlab.com by Daniel Shapiro   Dec 22, 2017 Desktop Mobile Checkout

Daniel Shapiro Tested Pattern #42: Countdown Timer In Test #138 On Trydesignlab.com

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #133 on Bing.com by Ronny Kohavi   Dec 13, 2017 Desktop Mobile Listing

Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.