Pattern #134: Optional or Confident Recommendation

Pattern #134  Tested 2 timesFirst tested by Katharina Lay Recently tested by Tim Karcher on Jul 29, 2025

Based on 2 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Optional or Confident Recommendation (Variant A) Optional or Confident Recommendation (Variant B)

Expected Median Effects Of B

?

Progression

(2 tests)

-

Leads

-

Signups

-

Engagement

?

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(2 tests)

Tests

Pattern #134: Optional or Confident Recommendation
Was Tested On Finn.com by Tim Karcher

Replaced

Isolated

Test # 602 on Finn.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Tim Karcher    Jul 29, 2025 Test link

Find Out How It Did With 13,718 Visitors

  • Measured by PDP viewed

  • Measured by adds to cart

In this experiment, the control contained a headline with a somewhat ambiguous choice, asking users to "Login or Register". Whereas the variation communicated a simpler action headline: "Let's go". Down funnel impact was measured (post-registration) on product page views and adds to cart. (This also was an irregular split ratio; not a 50/50 split)

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 519 on Volders.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Katharina Lay    Feb 23, 2024 Test link

Find Out How It Did With 58,597 Visitors

  • Measured by Chosen Upsell (Security)

  • Measured by Chosen Upsell (Express)

  • Measured by Overall Sales

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.