Discover UI Design Decisions Of Leading Companies,
From Leaked Screenshots & A/B Tests.


Showing 108 results

Leak #88 from   |   Oct 25, 2022 Product

Etsy Rejects Additional Customer Review Filters After This A/B Test

Etsy ran this a/b test where they showed additional customer review filters on selected product detail pages. The test was eventually rejected it seems. View Leak

Leak #87 from   |   Sep 26, 2022 Product

Amazon A/B Tests Bottom Aligned Product Thumbnails

Amazon attempted an image thumbnail experiment on their product pages. Instead using traditional left aligned thumbnails, they shifted them below the main image and increased their size. This is very similar to the left vs bottom thumbnail pattern we started tracking this year. View Leak

Leak #86 from   |   Sep 14, 2022 Listing

Walmart A/B Tests 4 vs 3 Column Listing Pages

Walmart just ran their very own 4 vs 3 column experiment on some of their listing pages. The a/b test seems to have had a similar hypothesis about product tile density to what Etsy ran just a few months ago. View Leak

Leak #85 from   |   Aug 16, 2022 Product

Etsy A/B Tests And Implements Required Field Labels

Here is a very tiny a/b test from Etsy - the marking of two product personalization fields as required using red asterisks. If I had to guess, I'd expect the effect on checkouts was probably very small if any (based on the pattern data so far). View Leak

Leak #84 from   |   Jul 19, 2022 Home & Landing

Airbnb Retests The Infamous Infinite Scroll

I believe Airbnb just a/b tested infinite scrolling and rolled it out. Sometime this year they evolved their homepage to include specific property listings. As  these property tiles appeared, a month ago I also managed to capture a screenshot of two versions of their homepage: one with 40 results per page that would load more listings with a "Show More" button; and another version with an endless or infinite scroll.  View Leak

Leak #83 from   |   Jul 7, 2022 Listing

Etsy A/B Tests 5 Vs 4 Listing Tiles

Etsy continues to run interesting and highly isolated layout experiments on their product listing pages. This time around they tested 5 product tiles per row against 4 tiles. View Leak

Leak #82 from   |   Jun 28, 2022 Product

Walmart A/B Tests Popular Product Tags

Walmart was noticed running a product detail page experiment with an added "popular picks" badge. The badges were added to some products based on some undecipherable logic. Other products would also sometimes show "best seller" badges, including being shown together. View Leak

Leak #81 from   |   Jun 8, 2022 Product

Amazon A/B Tests And Rolls Out Extra Product Information On Book Pages

Amazon ran an experiment where they showed additional product information on books. This included such structured information as: language, publisher, publication date, dimensions, etc. View Leak

Leak #80 from   |   May 10, 2022 Listing

Etsy Runs An A/B Test Suggesting That Less Isn't Necessarily More

This interesting experiment was discovered a month ago on Etsy's product listing screens. In a nutshell, more traditional and elaborate product tiles was aggressively shortened by removing a lot of information such as product names and customer reviews. This had the additional effect of shortening the tested listing pages. One more later, the experiment looks like it was rejected - hinting that less is not always more. :) View Leak

Leak #79 from   |   Apr 26, 2022 Product

Etsy A/B Tests Extra Product Collections

Etsy just completed a simple product page experiment. At the bottom of most of their product pages extra products were appended in the form of visual collections. View Leak

Leak #78 from   |   Mar 24, 2022 Listing

Etsy A/B/C Tests The Left Column Vs Overlay Filters On Listing Pages

Etsy ran an interesting filter experiment on their listing pages. The control's exposed filters on the left column were collapsed in two variations and made visible with the use of an overlay. One variation collapsed the filters completely while another added an extra layer of horizontal categories. View Leak

Leak #77 from   |   Feb 22, 2022 Product

Amazon Discovers A Better Product Option Selector In This A/B Test

Amazon has been experimenting with different formatting of product choice selections. Think of books being customized as hardcover, audio or paperback. Think of product quantities and colors. I've been observing Amazon run a sequence of such similar tests over the last few months and here is one such experiment with at least 3 properties that now have been implemented - hinting at higher optimality. View Leak

Leak #76 from   |   Feb 4, 2022 Product

Bol A/B Tested A More Padded Button

Last year I captured this button experiment from Bol (a leading online retailer in the Netherlands). They tested a smaller button with less padding against a slightly more bloated one. It's now clear that the variation was rolled out completely - consistent with the bigger form fields and buttons pattern. View Leak

Leak #75 from   |   Jan 11, 2022 Product

Amazon A/B Tested This Bigger Price Style

I managed to capture this exciting little big price styling experiment from Amazon before it wrapped up this week. What looks like a small change actually has a few interesting differences packed into a single variation which you can see below. View Leak

Leak #74 from   |   Dec 22, 2021 Product

Etsy A/B Tests Smaller & Shorter Product Titles

Etsy just ran a simple little experiment that changed their product titles into smaller and truncated ones. The outcome looks like it has been rejected so something didn't work out here. View Leak

Leak #73 from   |   Dec 9, 2021 Home & Landing

Walmart A/B Tested This Winning Homepage

Walmart a/b tested a new version of their homepage which I managed to capture screenshots of. Generally speaking, the new variation is basically longer with more types of products, more results, and a greater distinction between products and categories. After waiting a few weeks, we can also confirm that the new version was implemented - suggesting a possible improvement. View Leak

Leak #72 from   |   Oct 27, 2021 Product

Etsy A/B Tests A Different Price Style

Etsy just ran an a/b test of how prices were displayed on their product pages. The three related changes were detected as a single variation and it now seems like the experiment ended up being rejected - suggesting a loss or insignificant outcome. Although the changes were confounded, based on some positive data related to showing availability, perhaps removing the "In stock" copy was one change too many. Here is what the experiment looked like: View Leak

Leak #71 from   |   Oct 1, 2021 Home & Landing

Airbnb Discovers A Better Way To Let Customers Explore Listings

It looks like Airbnb once again ran an exciting experiment where they sought a better way to let customers explore property listings. I managed to detect an a/b test with changes to the homepage button which then spilled over into more changes on the listing page. I'll also admit that I am not 100% sure whether this was one bigger experiment on both pages or two separate ones. Either way, here are some of the particular differences I found really interesting ... View Leak

Leak #70 from   |   Sep 7, 2021 Listing

Airbnb A/B Tests More Filters On Their Listing Screens With This Outcome

Here is a filter experiment I managed to detect on Airbnb's listing pages a few months ago. At the outset it looks like Airbnb was simply trying to add more filter options, but in reality there are at least three changes confounded together. If we break these changes up into individual patterns we might learn that some of them might be better than others. Perhaps this combination or interaction of both negative and positive changes could be an explanation as to why it looks like the variation was eventually rejected. View Leak

Leak #69 from   |   Aug 11, 2021 Home & Landing

Airbnb Runs A Successful Leap Redesign Experiment For New Hosts

Airbnb just completed testing and rolling out a successful variation for their new host landing page. The interesting thing about this experiment is that it was a leap a/b test containing many changes (some of which are being followed up with small scale a/b tests as I'm writing this). Here is my take on some of the changes along with the corresponding patterns. View Leak