All Latest 644 A/B Tests

Test #160 on Examine.com by Martin WongMartin Wong Mar 15, 2018 Desktop Mobile Product X.X% Progression

Martin Tested Pattern #49: Above The Fold Call To Action On Examine.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 25,025 • Statistical Power at 5% MDE: 9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #157 on Bobandlush.com by Viljo VabritViljo Vabrit Mar 06, 2018 Desktop Product X.X% Progression

Viljo Tested Pattern #62: Urgent Next Day Delivery On Bobandlush.com

Pattern #62: Urgent Next Day Delivery - Variant A
Pattern #62: Urgent Next Day Delivery - Variant B

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.
Total Sample: 1,877 • Statistical Power at 5% MDE: 6.9%

Test #156 on Mt.com by Vito MediavillaVito Mediavilla Feb 25, 2018 Desktop Listing X.X% Progression

Vito Tested Pattern #60: Repeated Bottom Call To Action On Mt.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

This test duplicated two buttons at the bottom of the page. However, the site already contained floating buttons (from the header).
Total Sample: 27,048 • Statistical Power at 5% MDE: 12.8%

Test #155 on Mt.com by Vito MediavillaVito Mediavilla Feb 22, 2018 Mobile Product X.X% Progression

Vito Tested Pattern #3: Fewer Form Fields On Mt.com

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B
Total Sample: 8,652 • Statistical Power at 5% MDE: 5.3%

Test #152 on Reverb.com by Nicholas EvansNicholas Evans Feb 13, 2018 Desktop Mobile Product X.X% Progression

Nicholas Tested Pattern #15: Bulleted Reassurances On Reverb.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B
Total Sample: 487,851 • Statistical Power at 5% MDE: 29.3%

Test #151 on Mamaearth.ca by Michael BernsteinMichael Bernstein Feb 08, 2018 Desktop Checkout X.X% Progression

Michael Tested Pattern #45: Benefit Bar On Mamaearth.ca

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B
Total Sample: 1,614 • Statistical Power at 5% MDE: 7.4%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Progression

Nicholas Tested Pattern #20: Canned Response On Reverb.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #143 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Jan 14, 2018 Desktop Listing X.X% Progression

Rodrigo Tested Pattern #56: Hover Button On Vivareal.com.br

Pattern #56: Hover Button - Variant A
Pattern #56: Hover Button - Variant B
Total Sample: 2,594,182 • Statistical Power at 5% MDE: 99.9%

Test #142 on Streamlineicons.com by Vincent Le moignVincent Le moign Jan 13, 2018 Desktop Product X.X% Progression

Vincent Tested Pattern #27: More For Less Headline On Streamlineicons.com

Pattern #27: More For Less Headline - Variant A
Pattern #27: More For Less Headline - Variant B
Total Sample: 17,575 • Statistical Power at 5% MDE: 8%

Test #139 on Examine.com by Martin WongMartin Wong Jan 04, 2018 Desktop Pricing X.X% Progression

Martin Tested Pattern #51: Shortcut Buttons On Examine.com

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this test an additional "Purchase" button was shown along side a "Learn More" button. The "Purchase" button went straight to checkout, whereas the "Learn More" button went to a product overview page.
Total Sample: 18,620 • Statistical Power at 5% MDE: 7.6%

Test #137 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Progression

Daniel Tested Pattern #46: Pay Later On Trydesignlab.com

Pattern #46: Pay Later - Variant A
Pattern #46: Pay Later - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,218 • Statistical Power at 5% MDE: 7.3%

Test #138 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Dec 22, 2017 Desktop Mobile Checkout X.X% Progression

Daniel Tested Pattern #42: Countdown Timer On Trydesignlab.com

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

This test was run on a 3 step checkout process. The first screen was asking for contact information, and the second screen asked for credit card details. The change was shown on both first two steps as shown on the image below.
Total Sample: 2,258 • Statistical Power at 5% MDE: 8.2%

Test #135 on Akademiafotografii.p... by Grzegorz JancewiczGrzegorz Jancewicz Dec 18, 2017 Desktop Home & Landing X.X% Progression

Grzegorz Tested Pattern #4: Testimonials On Akademiafotografii.p...

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B
Total Sample: 3,927 • Statistical Power at 5% MDE: 5.8%

Test #134 on Kenhub.com by Niels HapkeNiels Hapke Dec 14, 2017 Desktop Product X.X% Progression

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this beautiful test, the key change was the introduction of a larger call to action linking to a premium / upgrade screen. The call to action was placed on the left sidebar which was floating. This is a great example of providing visibility to important elements by making them persistent.
Total Sample: 29,743 • Statistical Power at 5% MDE: 13.5%

Test #132 on Sjvc.edu by Phillip BarnesPhillip Barnes Dec 12, 2017 Mobile Home & Landing X.X% Progression

Phillip Tested Pattern #41: Sticky Call To Action On Sjvc.edu

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this test, a footer with a button to a lead form was turned into a floating one.
Total Sample: 1,437 • Statistical Power at 5% MDE: 4.2%

Test #131 on Kenhub.com by Niels HapkeNiels Hapke Dec 11, 2017 Desktop Home & Landing X.X% Progression

Niels Tested Pattern #11: Gradual Reassurance On Kenhub.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B
Total Sample: 121,291 • Statistical Power at 5% MDE: 98.8%

Test #127 on Glass.net by Mark FreedleMark Freedle Nov 23, 2017 Desktop Mobile Listing X.X% Progression

Mark Tested Pattern #42: Countdown Timer On Glass.net

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B
Total Sample: 61,034 • Statistical Power at 5% MDE: 23.7%

Test #119 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Nov 01, 2017 Desktop Listing X.X% Progression

Rodrigo Tested Pattern #36: Fewer Or More Results On Vivareal.com.br

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B
Total Sample: 2,452,622 • Statistical Power at 5% MDE: 99.9%

Test #120 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Nov 01, 2017 Desktop Listing X.X% Progression

Rodrigo Tested Pattern #37: List Or Grid View On Vivareal.com.br

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B
Total Sample: 1,847,933 • Statistical Power at 5% MDE: 99.9%