Pattern #79: Single Or Multiple Triggers

Pattern #79  Tested 6 timesFirst tested by Lars Skjold Iversen Recently tested by Jakub Linowski on Dec 15, 2022

Based on 6 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Single Or Multiple Triggers (Variant A) Single Or Multiple Triggers (Variant B)

Expected Median Effects Of B

?

Progression

(4 tests)

-

Leads

-

Signups

-

Engagement

?

Sales

(6 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(6 tests)

Tested on

Tests

Added

Isolated

Test # 279 on Umbraco.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Lars Skjold Iversen    Jan 16, 2020 Test link

Find Out How It Did With 22,540 Visitors

  • Measured by visiting any course landing page

  • Measured by starting any course checkout

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Get Access To See The Test Results

Replaced

Isolated

Test # 355 by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Jakub Linowski    May 28, 2021 Test link

Find Out How It Did With 26,902 Visitors

  • Measured by visits any product or variety page

  • Measured by adds to cart

  • Measured by total sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Get Access To See The Test Results

Added

Isolated

Test # 356 on Mvideo.ru by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Andrey Andreev    May 29, 2021 Test link

Find Out How It Did With 5,469,900 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Get Access To See The Test Results

Added

Isolated

Test # 368 on Mvideo.ru by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Andrey Andreev    Aug 02, 2021 Test link

Find Out How It Did With 2,278,698 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, popular categories were added at the bottom of a long ecommerce homepage. Impact on total sales was measured.

Get Access To See The Test Results

Added

Isolated

Test # 418 on Online.metro-cc.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Andrey Andreev    Jun 28, 2022 Test link

Find Out How It Did With 78,582 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, popular product category links were added near the bottom of the homepage of an online grocery store - Metro. Impact on completed sales was measured.

Get Access To See The Test Results

Added

Isolated

Test # 446 Dec 15, 2022 Test link

Find Out How It Did With 100,016 Visitors

  • Measured by adds to cart

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, an additional purchase trigger was added - the ability to start by chosing a gift announcement option. In the control, this same question was asked further in the purchase funnel (after adding to cart). In the variation, this question was surfaced earlier as an alternative way of starting the purchase. Impact on total sales was measured.

Get Access To See The Test Results

Leaks

Leak #1 from Airbnb.com   |   Feb 14, 2019 Product

Airbnb Added More Search Cues

A - Aug 11, 2018
B - Sep 24, 2018
C - Jan 2, 2019 IMPLEMENTED

In this leak, three Airbnb property page screenshots with different time frames have been compared. Having done this, it became clear that at least one design decision was made near the bottom of the screen - further confirmed by the final screenshot. View Leak

+0.25 Evidence

Leak #3 from Etsy.com   |   Mar 30, 2019 Product

Etsy A/B Tested And Implemented Related Products Thumbnails

A - Jan 2, 2019
B - Jan 2, 2019 IMPLEMENTED

Showing related products might be considered popular practice by now. If a customer doesn't feel that a given product is exactly what they are looking for, somewhere at the bottom of a page they might get nudged with other hopefully relevant product options. View Leak

+0.5 Evidence

Leak #79 from Etsy.com   |   Apr 26, 2022 Product

Etsy A/B Tests Extra Product Collections

A - Apr 13, 2022
B - Apr 13, 2022 IMPLEMENTED

Etsy just completed a simple product page experiment. At the bottom of most of their product pages extra products were appended in the form of visual collections. View Leak

+0.5 Evidence

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.