All Latest 650 A/B Tests

Test #439 on Designlab.com by Daniel ShapiroDaniel Shapiro Oct 31, 2022 Desktop Mobile Home & Landing X.X% Leads

Daniel Tested Pattern #18: Single Or Alternative Buttons On Designlab.com

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

This was a larger leap experiment with numerous changes to the header part of a design program landing page. One of the key changes however was a shift from a single to multiple call to actions for lead generation. In the control, all potential leads would first funnel through a single syllabus download flow. In the variation, users were given three visible choices: download syllabus, webinar signup and/or book a live call with admissions. Impact on overall generated leads was measured, as well as paid enrollments.

Total Sample: 7,713 • Statistical Power at 5% MDE: 7.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #437 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Oct 28, 2022 Desktop Mobile Listing X.X% Leads

Rodrigo Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional and alternative text based call to action link was added on real estate properity listings. Instead of only having "Ligar" ("Call"), "Enviar mensagem" was also appended ("Send Message"). This additional link lead to a lead-gen form. 

Total Sample: 2,595,541 • Statistical Power at 5% MDE: 99.9%

Test #438 on Phorest.com by Sorcha MullisSorcha Mullis Oct 28, 2022 Desktop Mobile Home & Landing X.X% Leads

Sorcha Tested Pattern #18: Single Or Alternative Buttons On Phorest.com

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, the addition of a secondary CTA for lead generation in the nav and the hero were tested. The additional button invited users to watch a gated demo video (approx 12 minutes). Clicking the CTA triggered a pop-up form collecting some basic contact information before the user could access the video page. Total leads were measured with lead form submittions. 

 

Total Sample: 34,059 • Statistical Power at 5% MDE: 9.2%

Test #436 on Designlab.com by Daniel ShapiroDaniel Shapiro Oct 25, 2022 Desktop Mobile Home & Landing X.X% Leads

Daniel Tested Pattern #7: Social Counts On Designlab.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, social proof and scarcity messages were shown on a course enrollment landing page. When students were starting to sign up at the beginning of each month (with greater availability), a simpler "X students have already enrolled in the next cohort" message was used.

Later in the month when fewer spots were available, a more scarce message was used with the following copy "ONLY X SPOTS available in the next cohort".

In both cases, the numbers were accurate and dynamically updated.

Total Sample: 11,214 • Statistical Power at 5% MDE: 8.6%

Test #433 on Expertinstitute.com by Ardit VeliuArdit Veliu Sep 30, 2022 Desktop Mobile Signup X.X% Leads

Ardit Tested Pattern #20: Canned Response On Expertinstitute.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B

In this experiment a dynamic canned response was added to a lead form. The contents of the copy reflected a handful of user choices from other form field selections. Impact on leads / form submissions was measured.

Total Sample: 14,490 • Statistical Power at 5% MDE: 13.3%

Test #426 on Phorest.com by Sorcha MullisSorcha Mullis Aug 09, 2022 Desktop Mobile Home & Landing X.X% Leads

Sorcha Tested Pattern #9: Multiple Steps On Phorest.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a single step popup modal was tested against a 4 step sign up funnel. Users entered the experiment on the homepage and the behavior of the two buttons, book a demo and get a quote, was adjusted. Impact on leads was measured.

Total Sample: 88,974 • Statistical Power at 5% MDE: 7.5%

Test #423 on Expertinstitute.com by Ardit VeliuArdit Veliu Jul 26, 2022 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #110: Optional Field Labels On Expertinstitute.com

Pattern #110: Optional Field Labels - Variant A
Pattern #110: Optional Field Labels - Variant B

In this experiment, an "optional" label was shown near a message form field. Impact on overall leads was measured (requesting experts).

Total Sample: 1,462 • Statistical Power at 5% MDE: 6.6%

Test #420 on Designlab.com by Daniel ShapiroDaniel Shapiro Jul 12, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #115: Pricing Comparison Table On Designlab.com

Pattern #115: Pricing Comparison Table - Variant A
Pattern #115: Pricing Comparison Table - Variant B

In this experiment, pricing plans were laid out horizontally for easier comparison. In the variation, most of the plan benefits, features and differences were also referenced using a single lable that was left-aligned. The idea was to make the variables aligned and therefore more comparable.

This pricing table appeared at the bottom of a long design program landing page. Impact on leads and applications was measured.

Total Sample: 9,521 • Statistical Power at 5% MDE: 14.3%

Test #416 on Designlab.com by Daniel ShapiroDaniel Shapiro Jun 20, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #105: Lead Magnets On Designlab.com

Pattern #105: Lead Magnets - Variant A
Pattern #105: Lead Magnets - Variant B

In this experiment, copy was added which communicated that students signing up for a course would receive extra design resources (the lead magnet). This was added in multiple states of the course page. Impact on lead generation and enrollment was measured.

Total Sample: 6,603 • Statistical Power at 5% MDE: 7.4%

Test #409 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 30, 2022 Desktop Mobile Signup X.X% Leads

Ardit Tested Pattern #20: Canned Response On Expertinstitute.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Total Sample: 2,831 • Statistical Power at 5% MDE: 6.9%

Test #404 on Expertinstitute.com by Ardit VeliuArdit Veliu Mar 31, 2022 Desktop Mobile Signup X.X% Leads

Ardit Tested Pattern #97: Bigger Form Fields On Expertinstitute.com

Pattern #97: Bigger Form Fields - Variant A
Pattern #97: Bigger Form Fields - Variant B

In this experiment, the button width was extended to the full width of the form above. Impact on leads was measured.

Total Sample: 6,408 • Statistical Power at 5% MDE: 8.6%

Test #122 on Designlab.com by Daniel ShapiroDaniel Shapiro Jan 22, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #30: Authentic Photos On Designlab.com

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B

In this experiment for an online design course, the variation had an extra section with student work previews. The previews were not clickable but were added just below the fold. Impact on leads was measured by potential students requesting a syllabus through an online form throughout the long landing page.

Total Sample: 9,862 • Statistical Power at 5% MDE: 7.4%

Test #381 on Expertinstitute.com by Ardit VeliuArdit Veliu Oct 30, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #49: Above The Fold Call To Action On Expertinstitute.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

In this experiment, an extra button to a signup lead form was placed above the fold. In the control, the same button appeared further down on the page.

Total Sample: 2,970 • Statistical Power at 5% MDE: 4.7%

Test #380 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Oct 27, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #21: What It's Worth On Getninjas.com.br

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experimemt, the average $ gain from a performed service category was shown on a landing page. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,347 • Statistical Power at 5% MDE: 14.2%

Test #374 on Expertinstitute.com by Ardit VeliuArdit Veliu Sep 15, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #9: Multiple Steps On Expertinstitute.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a lead form with numerous fields shown all at once, was broken down into 3 steps. The first step only asked for a Specialty choice that expanded into a list of options. Impact on full form completions was measured.

Total Sample: 5,628 • Statistical Power at 5% MDE: 7.5%

Test #369 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Aug 05, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #7: Social Counts On Getninjas.com.br

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experimemt, the number of service requests per month were shown that people can expect after signing up in a given category. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,256 • Statistical Power at 5% MDE: 14%

Test #362 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Jun 23, 2021 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #7: Social Counts On Vivareal.com.br

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, the number of recent property views was displayed under the call to action. Impact on overall lead generation was measured. (Translated using Google from Brazilian Portuguese.)

Total Sample: 7,087,369 • Statistical Power at 5% MDE: 99.9%

Test #352 on Us.flukecal.com by John HickeyJohn Hickey May 11, 2021 Desktop Global X.X% Leads

John Tested Pattern #123: Single Or Double Column Form Fields On Us.flukecal.com

Pattern #123: Single Or Double Column Form Fields - Variant A
Pattern #123: Single Or Double Column Form Fields - Variant B

In this experiment, single column (longer) form fields were tested against a two column layout (more compact).

Total Sample: 252 • Statistical Power at 5% MDE: 4.5%

Test #350 on Expertinstitute.com by Ardit VeliuArdit Veliu Apr 29, 2021 Desktop Content X.X% Leads

Ardit Tested Pattern #16: Welcome Mat - Partial On Expertinstitute.com

Pattern #16: Welcome Mat - Partial - Variant A
Pattern #16: Welcome Mat - Partial - Variant B

In this experiment, a lead generating section with a call to action (welcome mat) was appended at the top of article pages. Impact on lead generation was measured.

Total Sample: 34,967 • Statistical Power at 5% MDE: 3.9%

Test #104 on 3dhubs.com by Rob DraaijerRob Draaijer Mar 31, 2021 Desktop Listing X.X% Leads

Rob Tested Pattern #15: Bulleted Reassurances On 3dhubs.com

Pattern #15: Bulleted Reassurances - Variant A
Pattern #15: Bulleted Reassurances - Variant B

This experiment attempted to increase the number of leads on a lead-funnel. As the first step, users were being asked to upload a file. The control showed the file types that were allowed, whereas the variation changed the copy to show a number of benefits for taking that action. The text-based benefits included the: receiving feedback, prices and lead times.

Total Sample: 50,698 • Statistical Power at 5% MDE: 43%