Airbnb A/B Tested And Dropped Its Videos On The Host Signup Page
Videos are usually considered a popular growth tactic that people believe will improve conversion or signup rates. Hence I find it really interesting that Airbnb A/B tested a series of videos on their host signup landing page and then rejected them altogether. So why where these video removed?
Highlighted UI Changes From This Leak
The Tested Videos
It's quite clear that there was an active experiment which explored a series of high quality videos such as this one, this one and this one. The test setup also contained a variant without the videos as well, but with an additional testimonial in their place.
Most of the videos had a theme of placing the host as being in control which seems like a positive reassurance. The videos made it super clear that the hosts set the house rules, and can choose when to make their listing available for rent.
One thing which I though was a little surprising however was that each video showed various people even though the default video image would only show a single one. Sometimes the people in the snapshot and the video weren't the first ones to be shown when played. Could this subtle inconsistency of actors have anything to do with the test outcome? Not sure.
Or perhaps it's simply more effective to show a summary of reassurances (like the "We've got you covered" section) rather than raising a single question at a time. Perhaps bulleted summaries are quicker to scan and quicker to find the relevant answers than having to watch a 40 second video?
These of course are just retrospective guesses. Do you have any thoughts as to why possibly these videos didn't make the cut?