Pattern #14: Exposed Menu Options
Pattern #14 Tested 10 timesFirst tested by Lisa Seaman Recently tested by Samuel Hess on Dec 23, 2020
Based on 10 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
Booking.com A/B Tested And Exposed Incremental UI Controls
I especially like this particular leak because there is a slight possibility I might have actually inspired Booking to a/b test it - how cool is that? In late November of 2018 I shared some search concepts, one of which suggested incremental UI controls for Booking's guest selector. View Leak
Booking A/B Tested And Rolled Out An Expanded Calendar Control
This leaked experiment captures a very simple and isolated change on Booking's apartment landing page. The tested change was the automatic exposure of the calendar menu instead of keeping it collapsed (requiring an extra click to open the date picker). A few weeks later, the experiment was observed to have been completed with the exposed calendar version (B) as implemented. View Leak
Bol Discovers Something Better Than Classic Pulldown Menus, As Expected
When Bol ran their list vs grid view experiment, they also included a variation that tested for another very simple change: the exposure of menu options. That is, the listing page variant was designed to check if three more visible pull down options would be better or worse than just showing them hidden inside the pulldown. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.