Airbnb A/B Tested And Dropped Its Videos On The Host Signup Page

Leak 12   |   Leaked from Airbnb.com   |   Jun 10, 2019 Screen: Signup

Videos are usually considered a popular growth tactic that people believe will improve conversion or signup rates. Hence I find it really interesting that Airbnb A/B tested a series of videos on their host signup landing page and then rejected them altogether. So why where these video removed?

A - Mar 13, 2019 Screenshot
B - Mar 13, 2019 Screenshot
IMPLEMENTED Confirmed Jun 10, 2019
C - Jun 10, 2019 Screenshot

Highlighted UI Changes From This Leak

  1. The Tested Videos

    It's quite clear that there was an active experiment which explored a series of high quality videos such as this one, this one and this one. The test setup also contained a variant without the videos as well, but with an additional testimonial in their place.

    Most of the videos had a theme of placing the host as being in control which seems like a positive reassurance. The videos made it super clear that the hosts set the house rules, and can choose when to make their listing available for rent.

    One thing which I though was a little surprising however was that each video showed various people even though the default video image would only show a single one. Sometimes the people in the snapshot and the video weren't the first ones to be shown when played. Could this subtle inconsistency of actors have anything to do with the test outcome? Not sure.

    Or perhaps it's simply more effective to show a summary of reassurances (like the "We've got you covered" section) rather than raising a single question at a time. Perhaps bulleted summaries are quicker to scan and quicker to find the relevant answers than having to watch a 40 second video?

    These of course are just retrospective guesses. Do you have any thoughts as to why possibly these videos didn't make the cut?

Comments

  • Noemi Rozpara

    Noemi Rozpara 5 days ago 10

    I usually don't play videos on websites at all (this also applies to social media etc), I believe you can find required informations quicker in the text (your eye sees keywords, which can't be achieved in the video).

    Also the video of the place owner feels too persuasive for me (like "look at me, I'm soooo trustworthy"). I would feel much more safe if I saw other's testimonials instead.