All Latest 644 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

Test #196 on Vivareal.com.br by Vinicius Barros Peixoto Aug 14, 2018 Mobile Listing X.X% Leads

Vinicius Tested Pattern #80: Persistent Filters On Vivareal.com.br

Pattern #80: Persistent Filters - Variant A

Pattern #80: Persistent Filters - Variant B

The experiment goal was automatically applying filters the users have already done in our result page, during their navigation to the site. The variation always applied the filters in the same session and asked users on new sessions.

Total Sample: 441,738 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #194 on Bomgar.com by Lee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

Pattern #22: Empowering Headline - Variant A

Pattern #22: Empowering Headline - Variant B

Total Sample: 12,953 • Statistical Power at 5% MDE: 6.6%

Test #190 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

This test has explored numerous hamburger menu variations and has been covered in detail over at https://conversionxl.com/blog/testing-hamburger-icon-revenue/ - Thanks Peep Laja for sharing. Here we reported on a consistent increase in both menu clicks and sales.

Total Sample: 95,776 • Statistical Power at 5% MDE: 48%

Test #191 on Diamondcandles.com by Peep Laja Jul 26, 2018 Mobile Global X.X% Sales

Peep Tested Pattern #2: Icon Labels On Diamondcandles.com

Total Sample: 96,195 • Statistical Power at 5% MDE: 48.2%

Test #189 on Yummly.com by Kimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #7: Social Counts On Yummly.com

Total Sample: 259,933 • Statistical Power at 5% MDE: 98.8%

Test #187 on Trydesignlab.com by Will Anderson Jul 09, 2018 Desktop Mobile Product X.X% Sales

Will Tested Pattern #71: Personalized Next Step On Trydesignlab.com

Pattern #71: Personalized Next Step - Variant A

Pattern #71: Personalized Next Step - Variant B

In this experiment, a lead form (with a syllabus) would transform into the next application step of "enrolling" after being submitted. More so, this surfacing of the next enrollment step was personalized and shown for users that also returned to the web site in future visits.

Total Sample: 3,326 • Statistical Power at 5% MDE: 5.5%

Test #185 on Retrome.pl by Grzegorz Jancewicz Jul 03, 2018 Mobile Listing X.X% Leads

Grzegorz Tested Pattern #49: Above The Fold Call To Action On Retrome.pl

Pattern #49: Above The Fold Call To Action - Variant A

Pattern #49: Above The Fold Call To Action - Variant B

Total Sample: 823 • Statistical Power at 5% MDE: 4%

Test #184 on Bomgar.com by Lee Elkins Jun 25, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #15: Bulleted Reassurances On Bomgar.com

Pattern #15: Bulleted Reassurances - Variant A

Pattern #15: Bulleted Reassurances - Variant B

Total Sample: 5,455 • Statistical Power at 5% MDE: 5.7%

Test #179 on Yummly.com by Marcos Ciarrocchi May 18, 2018 Desktop Listing X.X% Signups

Marcos Tested Pattern #13: Centered Forms & Buttons On Yummly.com

Pattern #13: Centered Forms & Buttons - Variant A

Pattern #13: Centered Forms & Buttons - Variant B

Total Sample: 391,537 • Statistical Power at 5% MDE: 99.5%

Test #174 on Examine.com by Martin Wong May 13, 2018 Desktop Mobile Checkout X.X% Sales

Martin Tested Pattern #67: Currency & Taxes On Examine.com

Pattern #67: Currency & Taxes - Variant A

Pattern #67: Currency & Taxes - Variant B

Total Sample: 1,702 • Statistical Power at 5% MDE: 8.3%

Test #172 on Trydesignlab.com by Daniel Shapiro May 08, 2018 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A

Pattern #11: Gradual Reassurance - Variant B

Total Sample: 16,341 • Statistical Power at 5% MDE: 14.8%

Test #173 on Rollbar.com by Mike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

Total Sample: 8,433 • Statistical Power at 5% MDE: 4.3%

Test #169 on Mt.com by Vito Mediavilla Apr 24, 2018 Desktop Listing X.X% Leads

Vito Tested Pattern #37: List Or Grid View On Mt.com

Pattern #37: List Or Grid View - Variant A

Pattern #37: List Or Grid View - Variant B

Total Sample: 5,934 • Statistical Power at 5% MDE: 4.5%

Test #170 on Goodui.org by Jakub Linowski Apr 24, 2018 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

Total Sample: 11,616 • Statistical Power at 5% MDE: 3.6%

Test #166 on Olark.com by Sunir Shah Apr 05, 2018 Desktop Mobile Home & Landing X.X% Sales

Sunir Tested Pattern #12: Payment First On Olark.com

Olark's homepage was directing users towards a free forever trial - with followup nudges to upgrade some days later. The variation B of the experiment tested a more aggressive push to a pricing page page - with options to select a paid plan, as well as provide a credit card (getting the payment conversation out of the way sooner).

Total Sample: 61,916 • Statistical Power at 5% MDE: 7.3%

Test #164 on Examine.com by Martin Wong Apr 04, 2018 Desktop Mobile Thank You X.X% Sales

Martin Tested Pattern #50: Autoplay Video On Examine.com

In this test, the variation autoplayed the video (with sound). The thank you page offered a discount on a cross-sell product - The Supplement Goal Reference. The video first communicate a sincere thank you, followed by the product cross-sell.

Total Sample: 11,676 • Statistical Power at 5% MDE: 6%

Test #163 on Lovehoney.co.uk by Matthew Curry Mar 27, 2018 Mobile Desktop Product X.X% Revenue