All Latest 534 A/B Tests
Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first
MOST RECENT TESTS
Test #163 on Lovehoney.co.uk by Matthew Curry Mar 27, 2018 Mobile Desktop Product
Matthew Curry Tested Pattern #62: Urgent Next Day Delivery In Test #163 On Lovehoney.co.uk
Test #157 on Bobandlush.com by Viljo Vabrit Mar 06, 2018 Desktop Product
Viljo Vabrit Tested Pattern #62: Urgent Next Day Delivery In Test #157 On Bobandlush.com
Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.
The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Test #152 on Reverb.com by Nicholas Evans Feb 13, 2018 Desktop Mobile Product
Nicholas Evans Tested Pattern #15: Bulleted Reassurances In Test #152 On Reverb.com
Test #151 on Mamaearth.ca by Michael Bernstein Feb 08, 2018 Desktop Checkout
Michael Bernstein Tested Pattern #45: Benefit Bar In Test #151 On Mamaearth.ca
Test #150 on Normanrecords.com by Nathon Raine Feb 07, 2018 Desktop Home & Landing
Nathon Raine Tested Pattern #45: Benefit Bar In Test #150 On Normanrecords.com
Test #140 on Akademiafotografii.p... by Grzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product
Grzegorz Jancewicz Tested Pattern #46: Pay Later In Test #140 On Akademiafotografii.p...
The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".
Test #137 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout
Daniel Shapiro Tested Pattern #46: Pay Later In Test #137 On Trydesignlab.com
This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #138 on Trydesignlab.com by Daniel Shapiro Dec 22, 2017 Desktop Mobile Checkout
Daniel Shapiro Tested Pattern #42: Countdown Timer In Test #138 On Trydesignlab.com
This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #135 on Akademiafotografii.p... by Grzegorz Jancewicz Dec 18, 2017 Desktop Home & Landing
Grzegorz Jancewicz Tested Pattern #4: Testimonials In Test #135 On Akademiafotografii.p...
Test #136 on Missetam.nl by Marlies Wilms Floet Dec 18, 2017 Desktop Product
Marlies Wilms Floet Tested Pattern #42: Countdown Timer In Test #136 On Missetam.nl
De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.
Test #133 on Bing.com by Ronny Kohavi Dec 13, 2017 Desktop Mobile Listing
Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com
In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.
HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments
Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.
Test #128 on Acousticalsurfaces.c... by Nina Bayatti Dec 02, 2017 Desktop Signup
Nina Bayatti Tested Pattern #20: Canned Response In Test #128 On Acousticalsurfaces.c...
Test #127 on Glass.net by Mark Freedle Nov 23, 2017 Desktop Mobile Listing
Mark Freedle Tested Pattern #42: Countdown Timer In Test #127 On Glass.net
Test #117 on Ssdnodes.com by Matt Connor Oct 02, 2017 Desktop Shopping Cart
Matt Connor Tested Pattern #21: What It's Worth In Test #117 On Ssdnodes.com
Test #114 on Akademiafotografii.p... by Grzegorz Jancewicz Sep 01, 2017 Desktop Listing
Grzegorz Jancewicz Tested Pattern #32: Condensed List In Test #114 On Akademiafotografii.p...
Test #115 on Akademiafotografii.p... by Grzegorz Jancewicz Sep 01, 2017 Desktop Product
Grzegorz Jancewicz Tested Pattern #4: Testimonials In Test #115 On Akademiafotografii.p...
Test #100 on Vivareal.com.br by Rodrigo Maués Aug 01, 2017 Mobile Product
Rodrigo Maués Tested Pattern #20: Canned Response In Test #100 On Vivareal.com.br
Test #112 on Glass.net by Mark Freedle Jul 14, 2017 Desktop Mobile Signup
Mark Freedle Tested Pattern #20: Canned Response In Test #112 On Glass.net
Test #89 on Ssdnodes.com by Matt Connor Jun 01, 2017 Desktop Mobile Checkout
Matt Connor Tested Pattern #4: Testimonials In Test #89 On Ssdnodes.com
Test #109 on 3dhubs.com by Rob Draaijer Jun 01, 2017 Desktop Signup