All Latest 633 A/B Tests

MOST RECENT TESTS

Test #564 on Hellostake.com by Louis AlstonLouis Alston Nov 26, 2024 Desktop Mobile Home & Landing X.X% Signups

Louis Tested Pattern #114: Less Or More Visible Prices On Hellostake.com

 - Variant A
 - Variant B

In this a/b test, the headline was changed to reflect pricing information (informing that trades are starting at $3). Impact on progression and signups was measured.

Total Sample: 25,321 Statistical Power at 5% MDE: 6.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #482 on by Jakub LinowskiJakub Linowski Jul 13, 2023 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #124: Confirmed Selection

 - Variant A
 - Variant B

In this experiment, the choice of adding a product to cart was confirmed with a further positive message in the header of the next step (on the add to cart page). Once users left the product detail page, instead of simply stating the product name, the title was rephrased as "Product [X] Makes a Great Gift. They'll Love It!". I view this as a higher "intensity" experiment, given that the add-to-cart page was in some way already confirming the choice. Impact on sales was measured.

Total Sample: 3,379 Statistical Power at 5% MDE: 44%

Test #421 on Amazon.com by Marika FranciscoMarika Francisco Jul 15, 2022 Desktop Mobile Product X.X% Sales

Marika Tested Pattern #43: Long Titles On Amazon.com

 - Variant A
 - Variant B

Fluke is an industrial manufacterer of measurement and calibration devices and they ran a test on their Amazon store for a series of their prodcts. Instead of using short product names, they tested longer and more descriptive ones. Impact was measured on sales.

Total Sample: 3,727,581 Statistical Power at 5% MDE: 92.5%

Test #5 on Busyteacher.org by Andrei ZakhareuskiAndrei Zakhareuski Jan 23, 2022 Desktop Mobile Product X.X% Sales

Andrei Tested Pattern #21: What It's Worth On Busyteacher.org

 - Variant A
 - Variant B

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Total Sample: 4,895 Statistical Power at 5% MDE: 4%

Test #359 on Snocks.com by Samuel HessSamuel Hess Jun 11, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #43: Long Titles On Snocks.com

 - Variant A
 - Variant B

In this experiment, product titles were extended with descriptive copy. Instead of just showing the product name, "with organic cotton" was appended on product and category/listing pages. Impact to adds to cart and sales was measured.

Total Sample: 129,030 Statistical Power at 5% MDE: 79.9%

Test #314 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Aug 21, 2020 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #43: Long Titles On Zapimoveis.com.br

 - Variant A
 - Variant B

In this experiment, a dynamic page title was generated and added at the top of the screen. The first few words from a property description were used to dynamically generate these titles. The effect on leads was measured.

Total Sample: 6,533,516 Statistical Power at 5% MDE: 99.9%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

 - Variant A
 - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 Statistical Power at 5% MDE: 24.3%

Test #194 on Bomgar.com by Lee ElkinsLee Elkins Aug 08, 2018 Desktop Mobile Home & Landing X.X% Signups

Lee Tested Pattern #22: Empowering Headline On Bomgar.com

 - Variant A
 - Variant B
Total Sample: 12,953 Statistical Power at 5% MDE: 6.6%

Test #173 on Rollbar.com by Mike SmithMike Smith May 08, 2018 Desktop Mobile Home & Landing X.X% Engagement

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

 - Variant A
 - Variant B
Total Sample: 8,433 Statistical Power at 5% MDE: 4.3%

Test #161 on Examine.com by Martin WongMartin Wong Mar 19, 2018 Desktop Mobile Home & Landing X.X% Signups

Martin Tested Pattern #22: Empowering Headline On Examine.com

 - Variant A
 - Variant B
 - Variant A
 - Variant B
Total Sample: 77,568 Statistical Power at 5% MDE: 15.1%

Test #148 on Kenhub.com by Niels HapkeNiels Hapke Feb 01, 2018 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #53: Problem-Solution Headline On Kenhub.com

 - Variant A
 - Variant B
Total Sample: 49,448 Statistical Power at 5% MDE: 74.3%

Test #144 on Examine.com by Martin WongMartin Wong Jan 14, 2018 Desktop Mobile Product X.X% Sales

Martin Tested Pattern #27: More For Less Headline On Examine.com

 - Variant A
 - Variant B
Total Sample: 15,542 Statistical Power at 5% MDE: 7.8%

Test #142 on Streamlineicons.com by Vincent Le moignVincent Le moign Jan 13, 2018 Desktop Product X.X% Progression

Vincent Tested Pattern #27: More For Less Headline On Streamlineicons.com

 - Variant A
 - Variant B
Total Sample: 17,575 Statistical Power at 5% MDE: 8%

Test #96 on 3dhubs.com by Rob DraaijerRob Draaijer Apr 21, 2017 Desktop Mobile Home & Landing X.X% Leads

Rob Tested Pattern #61: Local Headline On 3dhubs.com

 - Variant A
 - Variant B
Total Sample: 20,274 Statistical Power at 5% MDE: 14.5%

Test #74 on Poll-app.com by Pierre Olivier MartelPierre Olivier Martel Jan 07, 2017 Desktop Home & Landing X.X% Signups

Pierre Olivier Tested Pattern #22: Empowering Headline On Poll-app.com

 - Variant A
 - Variant B
Total Sample: 7,217 Statistical Power at 5% MDE: 41%

Test #92 on Rollbar.com by Mike SmithMike Smith Jan 02, 2017 Desktop Mobile Home & Landing X.X% Signups

Mike Tested Pattern #22: Empowering Headline On Rollbar.com

 - Variant A
 - Variant B
Total Sample: 10,179 Statistical Power at 5% MDE: 7.3%

Test #37 on Onlinefaxes.com by Jaymie FriesenJaymie Friesen Apr 09, 2016 Desktop Mobile Home & Landing X.X% Sales

Jaymie Tested Pattern #27: More For Less Headline On Onlinefaxes.com

 - Variant A
 - Variant B
Total Sample: 21,822 Statistical Power at 5% MDE: 11.1%