Pattern #110: Optional Field Labels

Pattern #110  Tested 3 timesFirst tested by Julian Gaviria Recently tested by Ardit Veliu on Jul 26, 2022

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Optional Field Labels (Variant A) Optional Field Labels (Variant B)

Expected Median Effects Of B

-

Progression

X.X%

Leads

(1 tests)

X.X%

Signups

(2 tests)

-

Engagement

-

Sales

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(3 tests)

All 3 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

18.3% of 90% cumulative power target at 2% MDE from 3 tests Help replicate this with an A/B test

90%
↓
7% 8.7% 3.8%
Signup 2 tests: X%
Home & Landing 1 test: X%

Tested on

Tests

Pattern #110: Optional Field Labels
Was Tested On Thomasnet.com by Julian Gaviria

Added

Isolated

Test # 259 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Test link

Find Out How It Did With 5,890 Visitors

  • Measured by successful registrations

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Optional Field Labels - Variant A A
Optional Field Labels - Variant B B
Signup
Statistical Power by Minimum Detectable Effect
4%0.5%
4.8%1%
8.7%2%
31.9%5%
80%9.4%
84.4%10%
99.3%15%
99.9%20%

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 423 on Expertinstitute.... by Ardit VeliuArdit Veliu Jul 26, 2022 Test link

Find Out How It Did With 1,462 Visitors

  • Measured by form completions

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Optional Field Labels - Variant A A
Optional Field Labels - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.1%1%
3.8%2%
6.6%5%
14.5%10%
26.8%15%
42.5%20%
80%32.3%

In this experiment, an "optional" label was shown near a message form field. Impact on overall leads was measured (requesting experts).

Get Access To See The Test Results

Added

Isolated

Test # 258 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Test link

Find Out How It Did With 5,965 Visitors

  • Measured by successful registrations

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Optional Field Labels - Variant A A
Optional Field Labels - Variant B B
Signup
Statistical Power by Minimum Detectable Effect
3%0.5%
4.3%1%
7%2%
22.6%5%
66.9%10%
80%11.7%
94.7%15%
99.7%20%

In this variation an optional field label was added.

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.