Pattern #51: Shortcut Buttons
Pattern #51 Tested 8 timesFirst tested by
Martin Wong Recently tested by
Stanley Zuo on Aug 26, 2025
Based on 8 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
X.X%
Progression
(12 tests)
X.X%
Leads
(1 tests)
X.X%
Signups
(1 tests)
-
Engagement
X.X%
Sales
(7 tests)
X.X%
Revenue
(1 tests)
-
Retention
-
Referrals
X.X%
ANY PRIMARY
(8 tests)
All 7 tests meta-analyzed: combined effect (p-val X.XXXX)
29% of 90% cumulative power target at 2% MDE from 7 tests Help replicate this with an A/B test
Leaks
Amazon A/B Tests And Keeps Both Add-To-Cart And Buy Now Buttons
Two months ago I managed to detect that Amazon was actually a/b testing the removal of the second "Buy Now" button on a specific product page. Finally today it looks like the experiment has completed with both buttons still being displayed - like in the old days. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.


