Discover UI Design Decisions Of Leading Companies,
From Leaked Screenshots & A/B Tests.


Filter:
Company:

Showing 29 results

Leak 29   |   Leaked from Amazon.com   |   Oct 21, 2019 Screen: Product

Amazon Discovers That Product Availability And Price Belong Closer Towards Add To Cart

In this little experiment, Amazon shifted the availability information towards the center of its product pages. Instead of showing if and when a product will ship near the right add to cart tile, it was moved towards above the product description. Some weeks later, we discovered that this change was rejected in favor of showing the same information in the top right. View Leak

Leak 28   |   Leaked from Booking.com   |   Oct 16, 2019 Screen: Sitewide

Booking Sticks To A Traditional Breadcrumb After Rejecting A Multi-Dimensional One

Booking ran a sitewide experiment where they tested two types of breadcrumb navigation. The contending variation showed a breadcrumb with two dimensions: displaying the geographical hierarchy of how deep someone is within the site (as expected), and also displaying a menu (on-click) with a secondary dimension of stay types for each level. It might have seemed like a nice idea but it didn't cut it. As the a/b test completed, the idea was rejected in favor of the old-school breadcrumb approach. Nice try booking. :) View Leak

Leak 27   |   Leaked from Zalando.co.uk   |   Oct 7, 2019 Screen: Product

Zalando Rejects Black Add-To-Cart Buttons

Zalando has run a simple experiment on their product page where they challenged their existing orange add-to-cart button against a black one. One month later, the black button was rejected even though the black one had a higher contrast ratio.   View Leak

Leak 26   |   Leaked from Airbnb.com   |   Oct 3, 2019 Screen: Product Confirmed A/B Test

Airbnb Discovers A Better Way To Display Customer Ratings In This A/B Test

In this tiny and well isolated experiment, Airbnb tried a slightly different approach to displaying customer ratings on their property (product) pages. From the observed implementation decision one month later, we learned that using decimal places for customer rating averages seems to be the better approach. :)  View Leak

Leak 25   |   Leaked from Amazon.com   |   Sep 23, 2019 Screen: Product

Amazon's Beautifully Designed And Failed Three vs. Two Column Layout Experiment

Amazon found the courage to run a beautiful a/b test where they put their old three column product page layout against a new two column one. Although the two column layout was arguably more beautiful with the addition of white space, margins and shadows, it was nevertheless rejected. Before it was removed we decided to leak it here to ensure its beautiful failure continues to teach us well into the future. View Leak

Leak 24   |   Leaked from Airbnb.com   |   Sep 13, 2019 Screen: Home & Landing Confirmed A/B Test

Airbnb A/B Tests And Rejects Full Height Photos On Their Landing Page

Airbnb ran an experiment where they increased the size of the header photo on their Host signup landing page. And interestingly it was rejected a month later.   View Leak

Leak 23   |   Leaked from Zalando.de   |   Sep 9, 2019 Screen: Product Confirmed A/B Test

Zalando Rejects A/B Tested Company Logos And A Smaller Add-To-Cart Button

Zalando (Germany) has been experimenting with at least two interesting cascade variations on their product page. Both of these variations seem to have been rejected which is consistent with other evidence in favor of larger buttons.  View Leak

Leak 22   |   Leaked from Netflix.com   |   Sep 3, 2019 Screen: Home & Landing Confirmed A/B Test

Netflix A/B Tests And Rejects Secondary Sign-in And Sign-up Calls To Action

Netflix ran an experiment with two variations of appended secondary links underneath the main "Try It Now" button. One variation had a link urging users to sign-in, while another urged to resume signing-up. Both ideas didn't make it and have been rejected. Here are my thoughts and comparisons on this ... View Leak

Leak 21   |   Leaked from Google.com   |   Aug 28, 2019 Screen: Listing Confirmed A/B Test

Google's Recommended Questions Are Better Off Below Search Results

What's more important first - search results or recommended alternative questions based on what other users ask? It's now clear that Google ran such an experiment on their search results with a clear decision in favor of the former (showing real search results first). View Leak

Leak 20   |   Leaked from Netflix.com   |   Aug 22, 2019 Screen: Home & Landing Confirmed A/B Test

Netflix Finally Succeeds With These 3 Tested Home Page Patterns

If you might recall, some of the recent Netflix homepage experiments weren't so positive as seen here and here. Today however we finally detected what might be considered a successful roll out decision of one variation tested over a month ago. Gladly Netflix doesn't give up. Here are the 3 core changes which we think might have influenced a positive outcome. View Leak

Leak 19   |   Leaked from Airbnb.com   |   Aug 13, 2019 Screen: Product

Airbnb A/B Tested These 3 Button Labels And They All Failed

Button label tests are easy to setup, including this one that Airbnb ran on their property listing pages. In total we detected that they a/b tested 3 variations against the original control. One month later, all treatment variations were rejected suggesting that the "Reserve" button defended its superior performance. View Leak

Leak 18   |   Leaked from Netflix.com   |   Aug 6, 2019 Screen: Home & Landing Confirmed A/B Test

Netflix A/B Tests And Rejects Free Trials

Netflix has been offering a 30 day free trial for Canadians. Sometime in May however we spotted something way more interesting - they began a/b testing different trial durations (30, 14 and 7 days), as well as an immediate payment-first approach (without a trial). View Leak

Leak 17   |   Leaked from Booking.com   |   Jul 30, 2019 Screen: Home & Landing Confirmed A/B Test

Booking Also A/B Tests Icon Labels Replicating Google's Recent Experiment

It seems like Booking just completed running an experiment that is very similar to a recent one from Google. The experiment evaluated icons with labels in the top navigation against a control version with labels only.  View Leak

Leak 16   |   Leaked from Google.com   |   Jul 22, 2019 Screen: Listing

Google Has Been A/B Testing Link Colors (Again) And This Light Blue Didn't Pass

It's been a decade since it was first discovered that Google has famously tested those 41 shades of blue. Last month I discovered that they began experimenting with link colors on their search results screen - once again. This time Google tested a lighter blue with a lower contrast which turned out that they rejected (most likely due to a negative experiment result). View Leak

Leak 15   |   Leaked from Booking.com   |   Jul 18, 2019 Screen: Home & Landing Confirmed A/B Test

Booking's A/B Test Reveals More Impactful Search Criteria - Higher Location Tiles

Perhaps it's no surprise that when people wish to book a getaway, expressing a location is of higher importance than anything else. Interestingly, this has been confirmed in a recent Booking experiment which tested the position of various elements on their homepage. The A/B test, along with its implementation decision, revealed that shifting the location tiles higher up seems to have performed better. View Leak

Leak 14   |   Leaked from Google.com   |   Jul 1, 2019 Screen: Listing Confirmed A/B Test

Google's A/B Test Is Hinting That Labels With Icons Are Better Than Labels Alone

Take a look at these two screenshots, both taken on May 15, 2019. With some cookie clearing magic in between it's pretty clear that Google ran an icon experiment on their search results page. The control version had labels only in the top nav, whereas the variant contained icons in addition to the labels. The variation was implemented a month later in June. View Leak

Leak 13   |   Leaked from Airbnb.com   |   Jun 18, 2019 Screen: Signup Confirmed A/B Test

Airbnb Switched To A Bigger Button After Running This Design Experiment

Here is a perfectly simple optimization of a "Get started" button on Airbnb's host signup landing page. Airbnb ran an experiment of a smaller vs larger button size. I know because I managed to capture two diverse screenshots with the same date stamp. :) More so, a few months later Airbnb rolled out the later button to 100% of their traffic - hinting at a successful experiment outcome. View Leak

Leak 12   |   Leaked from Airbnb.com   |   Jun 10, 2019 Screen: Signup

Airbnb A/B Tested And Dropped Its Videos On The Host Signup Page

Videos are usually considered a popular growth tactic that people believe will improve conversion or signup rates. Hence I find it really interesting that Airbnb A/B tested a series of videos on their host signup landing page and then rejected them altogether. So why where these video removed? View Leak

Leak 11   |   Leaked from Airbnb.com   |   Jun 4, 2019 Screen: Product

Are Visible Cancellation Graphs Too Much - As Airbnb Learned In Their Failed Experiment?

Some months ago Airbnb ran this experiment where they exposed a beautifully designed cancellation graph. The graph showed a series of refund scenarios someone might be eligible for relatively to the check-in date (usually shrinking over time). Fast track into the future and there is no more sign of this variant as it returned into its collapsed state hiding from view. View Leak

Leak 10   |   Leaked from Booking.com   |   May 27, 2019 Screen: Listing

One Modal Too Far: Booking's Rejected Destination Overlay Experiment

Booking.com really likes to use popups, overlays and nudges of various shapes and sizes. Hey why don't you sign in? Why don't you pick your travel dates? Look, someone is about to rent out the room you're looking at. One of their recent destination listing experiments however hints that a particular modal was simply too much when it was eventually rejected. View Leak