All Latest 617 A/B Tests

MOST RECENT TESTS

Test #140 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product X.X% Leads

Grzegorz Tested Pattern #46: Pay Later On Akademiafotografii.p...

 - Variant A
 - Variant B

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #139 on Examine.com by Martin WongMartin Wong Jan 04, 2018 Desktop Pricing X.X% Sales

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

 - Variant A
 - Variant B

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

 - Variant A
 - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Sales

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

 - Variant A
 - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.

Test #136 on Missetam.nl by Marlies Wilms FloetMarlies Wilms Floet Dec 18, 2017 Desktop Product X.X% Sales

Marlies Wilms Tested Pattern #42: Countdown Timer On Missetam.nl

 - Variant A
 - Variant B

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Test #134 on Kenhub.com by Niels HapkeNiels Hapke Dec 14, 2017 Desktop Product X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

 - Variant A
 - Variant B

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.

Test #133 on Bing.com by Ronny KohaviRonny Kohavi Dec 13, 2017 Desktop Mobile Listing X.X% Revenue

Ronny Tested Pattern #43: Long Titles On Bing.com

 - Variant A
 - Variant B

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert.

HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments

Note: This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

 

Test #132 on Sjvc.edu by Phillip BarnesPhillip Barnes Dec 12, 2017 Mobile Home & Landing X.X% Leads

Phillip Tested Pattern #41: Sticky Call To Action On Sjvc.edu

 - Variant A
 - Variant B

In this test, a footer with a button to a lead form was turned into a floating one.

Test #130 on Kenhub.com by Niels HapkeNiels Hapke Dec 07, 2017 Desktop Pricing X.X% Revenue

Niels Tested Pattern #17: Least Or Most Expensive First On Kenhub.com

 - Variant A
 - Variant B

In this experiment, the plans were sorted by the most expensive first, left to right (variation).

Test #118 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Oct 01, 2017 Desktop Product X.X% Leads

Grzegorz Tested Pattern #34: Open In A New Tab On Akademiafotografii.p...

 - Variant A
 - Variant B

The only change in this test was the way links were opened on this course listings page. Variation A opened links in the same window, and variation B opened them in a new tab (and focusing on the newly opened screen).