Pattern #108: Frequently Asked Questions
Pattern #108 Tested 4 timesFirst tested by Jakub Linowski Recently tested by Ardit Veliu on Nov 19, 2024
Based on 4 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
?
Progression
(2 tests)
?
Leads
(2 tests)
-
Signups
-
Engagement
?
Sales
(2 tests)
-
Revenue
-
Retention
-
Referrals
?
ANY PRIMARY
(4 tests)
Tested on
Leaks
Netflix Finally Succeeds With These 3 Tested Home Page Patterns
If you might recall, some of the recent Netflix homepage experiments weren't so positive as seen here and here. Today however we finally detected what might be considered a successful roll out decision of one variation tested over a month ago. Gladly Netflix doesn't give up. Here are the 3 core changes which we think might have influenced a positive outcome. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.