Your filter results
Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first
Test #160 on
Examine.com
by
Martin Wong
Mar 15, 2018
Desktop
Mobile
Product
Martin Wong Tested Pattern #49: Above The Fold Call To Action In Test #160 On Examine.com


Test #158 on
Kenhub.com
by
Niels Hapke
Mar 11, 2018
Desktop
Mobile
Checkout
Niels Hapke Tested Pattern #63: Trust Seals In Test #158 On Kenhub.com


Test #159 on
Swimsuitsforall.com
by
Devesh Khanal
Mar 11, 2018
Desktop
Checkout
Devesh Khanal Tested Pattern #63: Trust Seals In Test #159 On Swimsuitsforall.com


Test #157 on
Bobandlush.com
by
Viljo Vabrit
Mar 06, 2018
Desktop
Product
Viljo Vabrit Tested Pattern #62: Urgent Next Day Delivery In Test #157 On Bobandlush.com


Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.
The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Test #156 on
Mt.com
by
Vito Mediavilla
Feb 25, 2018
Desktop
Listing
Vito Mediavilla Tested Pattern #60: Repeated Bottom Call To Action In Test #156 On Mt.com


This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).
Test #152 on
Reverb.com
by
Nicholas Evans
Feb 13, 2018
Desktop
Mobile
Product
Nicholas Evans Tested Pattern #15: Bulleted Reassurances In Test #152 On Reverb.com


Test #151 on
Mamaearth.ca
by
Michael Bernstein
Feb 08, 2018
Desktop
Checkout
Michael Bernstein Tested Pattern #45: Benefit Bar In Test #151 On Mamaearth.ca


Test #149 on
Reverb.com
by
Nicholas Evans
Feb 07, 2018
Desktop
Product
Nicholas Evans Tested Pattern #16: Welcome Mat - Partial In Test #149 On Reverb.com


Test #150 on
Normanrecords.com
by
Nathon Raine
Feb 07, 2018
Desktop
Home & Landing
Nathon Raine Tested Pattern #45: Benefit Bar In Test #150 On Normanrecords.com


Test #140 on
Akademiafotografii.p...
by
Grzegorz Jancewicz
Jan 05, 2018
Desktop
Mobile
Product
Grzegorz Jancewicz Tested Pattern #46: Pay Later In Test #140 On Akademiafotografii.p...


The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".
Test #139 on
Examine.com
by
Martin Wong
Jan 04, 2018
Desktop
Pricing
Martin Wong Tested Pattern #51: Shortcut Buttons In Test #139 On Examine.com


In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.
Test #137 on
Trydesignlab.com
by
Daniel Shapiro
Dec 22, 2017
Desktop
Mobile
Checkout
Daniel Shapiro Tested Pattern #46: Pay Later In Test #137 On Trydesignlab.com


This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #138 on
Trydesignlab.com
by
Daniel Shapiro
Dec 22, 2017
Desktop
Mobile
Checkout
Daniel Shapiro Tested Pattern #42: Countdown Timer In Test #138 On Trydesignlab.com


This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Test #135 on
Akademiafotografii.p...
by
Grzegorz Jancewicz
Dec 18, 2017
Desktop
Home & Landing
Grzegorz Jancewicz Tested Pattern #4: Testimonials In Test #135 On Akademiafotografii.p...


Test #136 on
Missetam.nl
by
Marlies Wilms Floet
Dec 18, 2017
Desktop
Product
Marlies Wilms Floet Tested Pattern #42: Countdown Timer In Test #136 On Missetam.nl


De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.
Test #134 on
Kenhub.com
by
Niels Hapke
Dec 14, 2017
Desktop
Product
Niels Hapke Tested Pattern #41: Sticky Call To Action In Test #134 On Kenhub.com


In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.
Test #133 on
Bing.com
by
Ronny Kohavi
Dec 13, 2017
Desktop
Mobile
Listing
Ronny Kohavi Tested Pattern #43: Long Titles In Test #133 On Bing.com


In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.
HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments
Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.
Test #132 on
Sjvc.edu
by
Phillip Barnes
Dec 12, 2017
Mobile
Home & Landing
Phillip Barnes Tested Pattern #41: Sticky Call To Action In Test #132 On Sjvc.edu


In this test, a footer with a button to a lead form was turned into a floating one.
Test #128 on
Acousticalsurfaces.c...
by
Nina Bayatti
Dec 02, 2017
Desktop
Signup
Nina Bayatti Tested Pattern #20: Canned Response In Test #128 On Acousticalsurfaces.c...


Test #127 on
Glass.net
by
Mark Freedle
Nov 23, 2017
Desktop
Mobile
Listing
Mark Freedle Tested Pattern #42: Countdown Timer In Test #127 On Glass.net

