Pattern #78: Tags, Badges And Structured Information

Pattern #78  Tested 7 timesFirst tested by Kimberly Cheung Recently tested by Daria Kurchinskaia on Feb 12, 2024

Based on 7 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Tags, Badges And Structured Information (Variant A) Tags, Badges And Structured Information (Variant B)

Expected Median Effects Of B

?

Progression

(3 tests)

?

Leads

(1 tests)

?

Signups

(3 tests)

-

Engagement

?

Sales

(4 tests)

?

Revenue

(1 tests)

-

Retention

-

Referrals

?

ANY PRIMARY

(7 tests)

Tested on

Tests

Pattern #78: Tags, Badges And Structured Information
Was Tested On Yummly.com by Kimberly Cheung

Added

Isolated

Test # 195 on Yummly.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Kimberly Cheung    Aug 13, 2018 Test link

Find Out How It Did With 371,274 Visitors

  • Measured by clicks on a card and visits recipe

  • Measured by full registrations

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Listing

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 517 on Aboalarm.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Daria Kurchinskaia    Feb 12, 2024 Test link

Find Out How It Did With 127,712 Visitors

  • Measured by overall revenue

  • Measured by completed purchases

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Checkout

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 489 Aug 14, 2023 Test link

Find Out How It Did With 173,808 Visitors

  • Measured by adds to cart

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, the size of a saving amount badge was enlarged. Instead of typical badge, the variation stretched the height of the saving information to the full height of the duration selector. The font size was also increased. Impact on overall sales was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 487 on Learnwithhomer.c... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo    Aug 10, 2023 Test link

Find Out How It Did With 19,769 Visitors

  • Measured by total trials started

  • Measured by annual trials started

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Pricing

In this experiment, a "save 50%" badge was replaced with a "most popular" one with the intent of encouraging more users to select the higher priced plan. Impact on total and annual trial starts was measured.

Get Access To See The Test Results

Added

Isolated

Test # 486 on Livefresh.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Pascal Dietz    Aug 03, 2023 Test link

Find Out How It Did With 416,423 Visitors

  • Measured by completed transactions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Does a "Bestseller" badge increase sales? This experiment tested exactly this by adding a visible badge on a juice cleansing product detail page.

Get Access To See The Test Results

Added

Isolated

Test # 449 on Snocks.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Melina Hess    Dec 31, 2022 Test link

Find Out How It Did With 508,908 Visitors

  • Measured by completed transactions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

In this experiment, bestselling product colors were highlighted with a bestseller badge on product listing and product detail pages.

Get Access To See The Test Results

Added

Isolated

Test # 284 on Thomasnet.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Julian Gaviria    Feb 19, 2020 Test link

Find Out How It Did With 241,428 Visitors

  • Measured by company listing views

  • Measured by company contact (RFI)

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Listing

In this experiment, structured data tags were displayed on a listing page to help potential buyers make better decisions. The additional information about the listed companies included: annual revenue, employee count, and year of establishment.

Get Access To See The Test Results

Leaks

Leak #59 from Amazon.com   |   Aug 19, 2020 Product

Amazon Discovers That Showing Structured Product Details Is Better

A - Aug 5, 2020
B - Aug 5, 2020 IMPLEMENTED

Amazon has been seen a/b testing the addition of product details or technical specifications, visibly above the fold. In this captured screenshot for example, we see such technical information as storage size, model numbers and types of interfaces. Interestingly, this change was rolled out when the experiment finished - hinting at a positive probability. View Leak

+0.5 Evidence

Leak #81 from Amazon.ca   |   Jun 8, 2022 Product

Amazon A/B Tests And Rolls Out Extra Product Information On Book Pages

A - Oct 1, 2021
B - Oct 1, 2021 IMPLEMENTED

Amazon ran an experiment where they showed additional product information on books. This included such structured information as: language, publisher, publication date, dimensions, etc. View Leak

+0.5 Evidence

Leak #82 from Walmart.com   |   Jun 28, 2022 Product

Walmart A/B Tests Popular Product Tags

A - Apr 18, 2022
B - Apr 18, 2022 IMPLEMENTED

Walmart was noticed running a product detail page experiment with an added "popular picks" badge. The badges were added to some products based on some undecipherable logic. Other products would also sometimes show "best seller" badges, including being shown together. View Leak

+0.5 Evidence

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.