Pattern #36: Fewer Or More Results
Pattern #36 Tested 4 timesFirst tested by Rodrigo Maués Recently tested by Melina Hess on Feb 28, 2023
Based on 4 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
Booking's Homepage Carousel Experiment Fails As Predicted
I was glad to detect this carousel experiment that Booking recently ran on their homepage because we've already seen similar experiments fail in the past. Instead of showing 5 location tiles, they tested a version that only showed 3 tiles at a time with an ability to slide for more - a carousel. It wasn't the automatic slider type that would unleash the wrath of Karl Gilis, but it was a user-invoked slider nevertheless. View Leak
Amazon Finally A/B Tests Their Full Vs. Fixed Width Layout In This Experiment
Amazon just completed this wonderful product page layout experiment. The experiment was visible on wider monitors where the main content column was set to either full width (control) or fixed to 1500 pixels (B variation). View Leak
Amazon A/B Tests The List Vs Grid Layout
A month ago I managed to detect this classic list vs grid layout experiment on two of Amazon's product listing pages. I learned that this a/b test ran at least on two random queries such as "tools for mechanics" and "sports gear". Today, the grid layout view now looks like it was implemented. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.