Pattern #7: Social Counts
Pattern #7 Tested 12 timesFirst tested by Jaymie Friesen Recently tested by Daniel Shapiro on Oct 25, 2022
Based on 12 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
Airbnb A/B Tests And Rejects Both Of These Social Proof Statements
Many companies have already tried and tested the pattern of displaying numerical social proof in some form or another. In this leaked experiment from Airbnb on their host signup landing page, we managed to detect two social proof statements that were eventually rejected. Here are some potential explanations as to possibly why they failed to deliver on an improvement. View Leak
Etsy A/B Tests "In X Carts" Social Proof Message
Etsy has been a/b testing a simple and common social proof element on some of their product pages. They showed how many users have recently added an item in their shopping carts. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.