Pattern #135: Product Categories

Pattern #135  Tested 8 timesFirst tested by Andrey Andreev Recently tested by Stanley Zuo on Mar 28, 2026

Based on 8 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Product Categories (Variant A) Product Categories (Variant B)

Expected Median Effects Of B

X.X%

Progression

(1 tests)

-

Leads

X.X%

Signups

(1 tests)

-

Engagement

X.X%

Sales

(8 tests)

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(8 tests)

All 8 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

83.7% of 90% cumulative power target at 1% MDE from 8 tests Help replicate this with an A/B test

90%
↓
46.3% 36.4% 3.6% 4.4% 28.2% 4.3% 17.8% 8.2%
Home & Landing 6 tests: X%
Product 1 test: X%
Global 1 test: X%

Tested on

Tests

Pattern #135: Product Categories
Was Tested On Mvideo.ru by Andrey Andreev

Added

Isolated

Test # 368 on Mvideo.ru by Andrey AndreevAndrey Andreev Aug 02, 2021 Test link

Find Out How It Did With 2,278,698 Visitors

  • Measured by completed sales

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
12%0.5%
36.4%1%
80%1.7%
89.6%2%
99.9%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, popular categories were added at the bottom of a long ecommerce homepage. Impact on total sales was measured.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 643 on Backstage.com by Stanley ZuoStanley Zuo Mar 28, 2026 Test link

Find Out How It Did With 112,266 Visitors

  • Measured by search starts

  • Measured by email signups

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
5%0.5%
8.2%1%
20.3%2%
80%5%
80%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, more popular search categories (pills) were shown on the homepage based on analyzed search volume. Impact on searches and email subscriptions were measured.

Get Access To See The Test Results

Added

Isolated

Test # 613 on Online.metro-cc.... by Andrey AndreevAndrey Andreev Sep 30, 2025 Test link

Find Out How It Did With 1,716,300 Visitors

  • Measured by completed sales (unique)

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
7%0.5%
17.8%1%
54.3%2%
80%2.7%
99.9%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, a series of brand logos with links to product listing pages were added - enabling another layer of search. Impact on products purchased was measured.

Get Access To See The Test Results

Added

Isolated

Test # 567 on Online.metro-cc.... by Andrey AndreevAndrey Andreev Dec 18, 2024 Test link

Find Out How It Did With 474,550 Visitors

  • Measured by sales (returning users)

  • Measured by sales (new users)

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
4.3%1%
7%2%
22.6%5%
66.5%10%
80%11.8%
94.3%15%
99.7%20%

In this experiment, the variation added popular categories with links at the top of the homepage. This was done for all sets of user segments: new and returning. Impact on transactions was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 539 on Snocks.com by Melina HessMelina Hess Jun 24, 2024 Test link

Find Out How It Did With 1,075,901 Visitors

  • Measured by completed purchases

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Global
Statistical Power by Minimum Detectable Effect
10%0.5%
28.7%1%
79.6%2%
80%2%
99.9%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

Get Access To See The Test Results

Added

Isolated

Test # 537 on Online.metro-cc.... by Andrey AndreevAndrey Andreev Jun 19, 2024 Test link

Find Out How It Did With 100,360 Visitors

  • Measured by completed purchases

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Product
Statistical Power by Minimum Detectable Effect
3%0.5%
4.4%1%
7.4%2%
24.4%5%
70.6%10%
80%11.2%
96%15%
99.8%20%

In this experiment, a simple product category link was added on product detail pages. These links linked to listing pages with more of a similar product type. Impact on sales was measured.

Get Access To See The Test Results

Added

Isolated

Test # 418 on Online.metro-cc.... by Andrey AndreevAndrey Andreev Jun 28, 2022 Test link

Find Out How It Did With 78,582 Visitors

  • Measured by completed sales

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
3%0.5%
3.6%1%
5.1%2%
12.6%5%
36.2%10%
66.4%15%
80%17.8%
88.1%20%

In this experiment, popular product category links were added near the bottom of the homepage of an online grocery store - Metro. Impact on completed sales was measured.

Get Access To See The Test Results

Added

Isolated

Test # 356 on Mvideo.ru by Andrey AndreevAndrey Andreev May 29, 2021 Test link

Find Out How It Did With 5,469,900 Visitors

  • Measured by completed sales

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Product Categories - Variant A A
Product Categories - Variant B B
Home & Landing
Statistical Power by Minimum Detectable Effect
15%0.5%
46.3%1%
80%1.5%
96.1%2%
99.9%5%
99.9%10%
99.9%15%
99.9%20%

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.