All Latest 633 A/B Tests

Test #189 on Yummly.com by Kimberly CheungKimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

- Variant A
- Variant B
Total Sample: 259,933 • Statistical Power at 5% MDE: 98.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #187 on Trydesignlab.com by Will AndersonWill Anderson Jul 09, 2018 Desktop Mobile Product X.X% Sales

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

- Variant A
- Variant B

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits. 
Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%

Test #185 on Retrome.pl by Grzegorz JancewiczGrzegorz Jancewicz Jul 03, 2018 Mobile Listing X.X% Leads

Grzegorz Tested Pattern #49: Above The Fold Call To Action On Retrome.pl

- Variant A
- Variant B
Total Sample: 823 • Statistical Power at 5% MDE: 4%

Test #184 on Bomgar.com by Lee ElkinsLee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

- Variant A
- Variant B
Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Test #179 on Yummly.com by Marcos CiarrocchiMarcos Ciarrocchi May 18, 2018 Desktop Listing X.X% Signups

Marcos Tested Pattern #13: Centered Forms & Buttons On Yummly.com

- Variant A
- Variant B
Total Sample: 391,537 • Statistical Power at 5% MDE: 99.5%

Test #174 on Examine.com by Martin WongMartin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

- Variant A
- Variant B
Total Sample: 1,702 • Statistical Power at 5% MDE: 8.3%

Test #173 on Rollbar.com by Mike SmithMike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

- Variant A
- Variant B
Total Sample: 8,433 • Statistical Power at 5% MDE: 4.3%

Test #172 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

- Variant A
- Variant B
Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #169 on Mt.com by Vito MediavillaVito Mediavilla Apr 24, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #37: List Or Grid View On Mt.com

- Variant A
- Variant B
Total Sample: 5,934 • Statistical Power at 5% MDE: 4.5%

Test #170 on Goodui.org by Jakub LinowskiJakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

- Variant A
- Variant B
Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #166 on Olark.com by Sunir ShahSunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

- Variant A
- Variant B

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).
Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #164 on Examine.com by Martin WongMartin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

- Variant A
- Variant B

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.
Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #163 on Lovehoney.co.uk by Matthew CurryMatthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Revenue

Matthew Tested Pattern #62: Urgent Next Day Delivery On Lovehoney.co.uk

- Variant A
- Variant B

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

- Variant A
- Variant B
- Variant A
- Variant B
Total Sample: 77,568 • Statistical Power at 5% MDE: 15.1%

Test #154 on Reverb.com by Nicholas EvansNicholas Evans Feb 20, 2018 Desktop Mobile Product X.X% Signups

Nicholas Tested Pattern #59: Inverted Or Consistent Button Styles On Reverb.com

- Variant A
- Variant B
Total Sample: 725,114 • Statistical Power at 5% MDE: 19.4%

Test #153 on Goodui.org by Jakub LinowskiJakub Linowski Feb 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #58: Full Height False Bottom On Goodui.org

- Variant A
- Variant B
Total Sample: 11,330 • Statistical Power at 5% MDE: 8.6%

Test #148 on Kenhub.com by Niels HapkeNiels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

- Variant A
- Variant B
Total Sample: 49,448 • Statistical Power at 5% MDE: 74.3%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

- Variant A
- Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

- Variant A
- Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #145 on Normanrecords.com by Nathon RaineNathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

- Variant A
- Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.
Total Sample: 4,139 • Statistical Power at 5% MDE: 73.7%