All Latest 634 A/B Tests

Test #373 on Backstage.com by Stanley ZuoStanley Zuo Sep 06, 2021 Mobile Listing X.X% Sales

Stanley Tested Pattern #32: Condensed List On Backstage.com

 - Variant A
 - Variant B

In this experiment, listing descriptions were shortened dynamically using exposable "more" links. This way, the variation showed shorter listings and therefore more listings per screens. Impact on listing clicks (progression) along with membership starts was measured.

Total Sample: 43,469 Statistical Power at 5% MDE: 92.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #372 on Fluke.com by Marika FranciscoMarika Francisco Aug 30, 2021 Desktop Product X.X% Sales

Marika Tested Pattern #122: Zigzag Layout On Fluke.com

 - Variant A
 - Variant B

In this experiment, product descriptions were changed to an alternating zig zag layout with images. Impact on adds-to-cart and sales was measured.

Total Sample: 18,325 Statistical Power at 5% MDE: 3.2%

Test #369 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Aug 05, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #7: Social Counts On Getninjas.com.br

 - Variant A
 - Variant B

In this experimemt, the number of service requests per month were shown that people can expect after signing up in a given category. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,256 Statistical Power at 5% MDE: 14%

Test #366 on Mvideo.ru by Andrey AndreevAndrey Andreev Jul 14, 2021 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #93: Auto Next On Mvideo.ru

 - Variant A
 - Variant B

In this experiment, the interaction on a product page was changed. In the control (A), after clicking "add to cart", the customer would remain on the product page with an updated basket and the button changing to "Go To Cart". The variation (B) however took customers forward automatically to the cart.

Total Sample: 80,881 Statistical Power at 5% MDE: 95%

Test #361 on Chaosgroup.com by Velin PenevVelin Penev Jun 22, 2021 Desktop Product X.X% Sales

Velin Tested Pattern #49: Above The Fold Call To Action On Chaosgroup.com

 - Variant A
 - Variant B

In this experiment, a pricing plan selector was shifted from the very bottom of a long product page towards (almost) the top. Impact on any transactions or sales was measured.

Total Sample: 49,030 Statistical Power at 5% MDE: 6.5%

Test #358 on Preply.com by Gleb HodorovskiyGleb Hodorovskiy Jun 03, 2021 Desktop Home & Landing X.X% Sales

Gleb Tested Pattern #58: Full Height False Bottom On Preply.com

 - Variant A
 - Variant B

In this experiment, the header section of the homepage drastically focused around the call to action. This was done by removing elements and forcing a false bottom.

Total Sample: 133,252 Statistical Power at 5% MDE: 14.8%

Test #357 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Jun 02, 2021 Desktop Mobile Pricing X.X% Signups

Brian Tested Pattern #113: More Or Fewer Plans On Baremetrics.com

 - Variant A
 - Variant B

In this experiment, a single focus signup was transformed into a pricing comparison table. Impact on signups was measured.

Total Sample: 4,947 Statistical Power at 5% MDE: 5.5%

Test #355 on by Jakub LinowskiJakub Linowski May 28, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #79: Product Highlights

 - Variant A
 - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 Statistical Power at 5% MDE: 30.7%

Test #353 on Backstage.com by Stanley ZuoStanley Zuo May 12, 2021 Desktop Product X.X% Signups

Stanley Tested Pattern #13: Centered Forms & Buttons On Backstage.com

 - Variant A
 - Variant B

This experiment challanged a right aligned detail page. After clicking a result of a job role on a listing page, an overlay would appear on the right with the details. The variation used a full width screen instead - effectively centering the page.

Total Sample: 30,428 Statistical Power at 5% MDE: 53.6%

Test #352 on Us.flukecal.com by John HickeyJohn Hickey May 11, 2021 Desktop Global X.X% Leads

John Tested Pattern #123: Single Or Double Column Form Fields On Us.flukecal.com

 - Variant A
 - Variant B

In this experiment, single column (longer) form fields were tested against a two column layout (more compact).

Total Sample: 252 Statistical Power at 5% MDE: 4.5%

Test #351 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Apr 30, 2021 Desktop Mobile Home & Landing X.X% Signups

Brian Tested Pattern #11: Gradual Reassurance On Baremetrics.com

 - Variant A
 - Variant B

In this experiment, static integration logos were replaced with selectable ones that reassured users to signup. After clicking an integration logo, a comparison chart would appear showing how Baremetrics improves upon a selected payment processor, along with a call to signup. Impact on signups was measured.

Total Sample: 24,416 Statistical Power at 5% MDE: 7%

Test #348 on Flukenetworks.com by Marika FranciscoMarika Francisco Apr 22, 2021 Desktop Home & Landing X.X% Progression

Marika Tested Pattern #97: Bigger Form Fields On Flukenetworks.com

 - Variant A
 - Variant B

In this simple experiment, the size of the "Get Quote" button in the top navigation was increased. 

Total Sample: 39,992 Statistical Power at 5% MDE: 4.3%

Test #347 on by Jakub LinowskiJakub Linowski Apr 07, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 Statistical Power at 5% MDE: 15.8%

Test #104 on 3dhubs.com by Rob DraaijerRob Draaijer Mar 31, 2021 Desktop Listing X.X% Leads

Rob Tested Pattern #15: Bulleted Reassurances On 3dhubs.com

 - Variant A
 - Variant B

This experiment attempted to increase the number of leads on a lead-funnel. As the first step, users were being asked to upload a file. The control showed the file types that were allowed, whereas the variation changed the copy to show a number of benefits for taking that action. The text-based benefits included the: receiving feedback, prices and lead times.

Total Sample: 50,698 Statistical Power at 5% MDE: 43%

Test #345 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Mar 29, 2021 Desktop Home & Landing X.X% Leads

Rodolfo Tested Pattern #9: Multiple Steps On Getninjas.com.br

 - Variant A
 - Variant B

In this experiment, a single long form was broken into at least 3 steps. 

Total Sample: 401,145 Statistical Power at 5% MDE: 99.9%

Test #343 on Snocks.com by Samuel HessSamuel Hess Mar 12, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Snocks.com

 - Variant A
 - Variant B

In this experiment, the content on a product page was reorganized into a zigzagging (alternating layout) along with reinforcing photos. Impact on adds-to-cart and total sales was measured.

Total Sample: 23,865 Statistical Power at 5% MDE: 32.9%

Test #342 on Backstage.com by Stanley ZuoStanley Zuo Feb 28, 2021 Desktop Mobile Listing X.X% Engagement

Stanley Tested Pattern #25: Nagging Results On Backstage.com

 - Variant A
 - Variant B

In this experiment, a registration wall was added on a listing page of casting call profiles. The registration wall appeared after the first 9 listings or so and encouraged users to sign up. Impact on registrations was measured, along with an engagement metric of "posting a job".

Total Sample: 7,934 Statistical Power at 5% MDE: 5.9%

Test #341 on by Alex JamesAlex James Feb 25, 2021 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #35: Floating Labels

 - Variant A
 - Variant B

This experiment shows a comparison between floating-field labels vs top-aligned labels. Form labels first appeared inline and as users would begin typing, they floated to the top of the field. In the other version, fixed field labels were shown above the form fields at all times. Impact on signups was measured.

Total Sample: 579,148 Statistical Power at 5% MDE: 99.9%

Test #337 on Backstage.com by Stanley ZuoStanley Zuo Jan 28, 2021 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #51: Shortcut Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, a listing page was expanded to show two actions (apply and view details) instead of a single one (view details only). In the variant, the "view detail" links were replaced with "apply links" starting a job application (and membership flows) sooner. 

Total Sample: 159,693 Statistical Power at 5% MDE: 16.1%

Test #333 on Expertinstitute.com by Ardit VeliuArdit Veliu Dec 31, 2020 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #11: Gradual Reassurance On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, the variation broke up a lead form into two parts. In the first step users were asked for their state followed by a standard contact form on a second step. All of the states were shown as selectable options. In the control version, the landing page only showed a button which lead to the full form. The experiment measured impact on lead form submissions.

Total Sample: 11,258 Statistical Power at 5% MDE: 6.1%