Pattern #113: More Or Fewer Plans
Pattern #113 Tested 6 timesFirst tested by
Stanley Zuo Recently tested by
Jakub Linowski on Aug 21, 2025
Based on 6 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
X.X%
Progression
(3 tests)
-
Leads
X.X%
Signups
(1 tests)
-
Engagement
X.X%
Sales
(4 tests)
X.X%
Revenue
(4 tests)
-
Retention
-
Referrals
X.X%
ANY PRIMARY
(6 tests)
All 2 tests meta-analyzed: combined effect (p-val X.XXXX)
6.7% of 90% cumulative power target at 2% MDE from 2 tests Help replicate this with an A/B test
Leaks
Netflix A/B Tests A Single Plan Recommendation And It Becomes Rejected
Netflix made a bold move and challenged their traditional 3 plan pricing page with a preselected single plan recommendation. Clear and equally balanced choice vs. a single mid tier plan. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.

