All Latest 633 A/B Tests

MOST RECENT TESTS

Test #140 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Jan 05, 2018 Desktop Mobile Product X.X% Leads

Grzegorz Tested Pattern #46: Pay Later On Akademiafotografii.p...

 - Variant A
 - Variant B

The test was run on multiple course pages. The screenshot contains the cropped bottom part of a long screen with an exposed signup form. The variation introduced additional text above the form which states: "Free Cancellation. Payment is not required today".

Total Sample: 37,727 Statistical Power at 5% MDE: 19.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #141 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jan 05, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #49: Above The Fold Call To Action On Trydesignlab.com

 - Variant A
 - Variant B

The variation introduced a call to action at the top of the screen that linked to a form deep down on a long course page.

Total Sample: 5,789 Statistical Power at 5% MDE: 6.4%

Test #136 on Missetam.nl by Marlies Wilms FloetMarlies Wilms Floet Dec 18, 2017 Desktop Product X.X% Sales

Marlies Wilms Tested Pattern #42: Countdown Timer On Missetam.nl

 - Variant A
 - Variant B

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Test #134 on Kenhub.com by Niels HapkeNiels Hapke Dec 14, 2017 Desktop Product X.X% Sales

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

 - Variant A
 - Variant B

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.

Total Sample: 29,743 Statistical Power at 5% MDE: 13.5%

Test #125 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Nov 13, 2017 Desktop Product X.X% Leads

Rodrigo Tested Pattern #38: Faded Background Form On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 2,628,666 Statistical Power at 5% MDE: 99.9%

Test #118 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Oct 01, 2017 Desktop Product X.X% Leads

Grzegorz Tested Pattern #34: Open In A New Tab On Akademiafotografii.p...

 - Variant A
 - Variant B

The only change in this test was the way links were opened on this course listings page. Variation A opened links in the same window, and variation B opened them in a new tab (and focusing on the newly opened screen).

Total Sample: 3,923 Statistical Power at 5% MDE: 5.8%

Test #115 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Sep 01, 2017 Desktop Product X.X% Leads

Grzegorz Tested Pattern #4: Testimonials On Akademiafotografii.p...

 - Variant A
 - Variant B
Total Sample: 13,817 Statistical Power at 5% MDE: 9.8%

Test #100 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Aug 01, 2017 Mobile Product X.X% Leads

Rodrigo Tested Pattern #20: Canned Response On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 203,704 Statistical Power at 5% MDE: 52.6%

Test #106 on Examine.com by Martin WongMartin Wong May 23, 2017 Desktop Product X.X% Sales

Martin Tested Pattern #15: Bulleted Reassurances On Examine.com

 - Variant A
 - Variant B

Three reassurances were added underneath each purchase button: Lifetime Updates, Works On All Devices and Money-Back Guarantee.

Total Sample: 10,576 Statistical Power at 5% MDE: 6.5%

Test #107 on Examine.com by Martin WongMartin Wong May 22, 2017 Desktop Product X.X% Sales

Martin Tested Pattern #14: Exposed Menu Options On Examine.com

 - Variant A
 - Variant B
Total Sample: 10,662 Statistical Power at 5% MDE: 6.8%

Test #102 on Vivareal.com.br by Rodrigo MauésRodrigo Maués May 02, 2017 Desktop Mobile Product X.X% Leads

Rodrigo Tested Pattern #24: Visible Availability On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 250,533 Statistical Power at 5% MDE: 88.6%

Test #87 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Mar 01, 2017 Desktop Mobile Product X.X% Leads

Rodrigo Tested Pattern #15: Bulleted Reassurances On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 102,305 Statistical Power at 5% MDE: 44%

Test #85 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Mar 01, 2017 Desktop Mobile Product X.X% Leads

Rodrigo Tested Pattern #3: Fewer Form Fields On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 102,331 Statistical Power at 5% MDE: 49.3%

Test #46 on Hylokusa.com by Julian GaviriaJulian Gaviria Feb 01, 2017 Desktop Product X.X% Progression

Julian Tested Pattern #60: Repeated Bottom Call To Action On Hylokusa.com

 - Variant A
 - Variant B
Total Sample: 1,416 Statistical Power at 5% MDE: 4.5%

Test #79 on by Chris GowardChris Goward Jan 10, 2017 Desktop Product X.X% Sales

Chris Tested Pattern #15: Bulleted Reassurances

 - Variant A
 - Variant B
Total Sample: 11,006 Statistical Power at 5% MDE: 21%

Test #80 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Jan 03, 2017 Mobile Product X.X% Leads

Rodrigo Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

 - Variant A
 - Variant B
Total Sample: 58,510 Statistical Power at 5% MDE: 45.4%

Test #63 on Vanityplanet.com by Doug BaltmanDoug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

 - Variant A
 - Variant B
Total Sample: 6,000 Statistical Power at 5% MDE: 7.6%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

 - Variant A
 - Variant B
Total Sample: 19,399 Statistical Power at 5% MDE: 48.7%

Test #54 on by Chris GowardChris Goward Aug 11, 2016 Desktop Mobile Product X.X% Leads

Chris Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

Client background (e.g. industry, business model):

This client is a healthcare company: their website is designed for lead generation. This company collects leads for their kidney-focused programs and ultimately provides kidney dialysis for those who decide to become patients.

 

Experiment background:

This experiment was focused on a right rail and the goal was to encourage more users to sign up to download the client’s free diabetes-friendly cookbook.

Total Sample: 95,073 Statistical Power at 5% MDE: 12.4%

Test #38 on Mt.com by Vito MediavillaVito Mediavilla May 01, 2016 Desktop Product X.X% Leads

Vito Tested Pattern #10: Postponed Modal Forms On Mt.com

 - Variant A
 - Variant B
Total Sample: 13,526 Statistical Power at 5% MDE: 9.2%