Pattern #33: Example Situations

Pattern #33  Tested 3 timesFirst tested by Sumantha Shankaranarayana Recently tested by Sorcha Mullis on Dec 14, 2022

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Example Situations (Variant A) Example Situations (Variant B)

Expected Median Effects Of B

?

Progression

(1 tests)

?

Leads

(3 tests)

-

Signups

-

Engagement

-

Sales

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(3 tests)

Tested on

Tests

Pattern #33: Example Situations
Was Tested On Phorest.com by Sorcha Mullis

Added

Isolated

Test # 445 on Phorest.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Sorcha Mullis    Dec 14, 2022 Test link

Find Out How It Did With 132,525 Visitors

  • Measured by completed lead forms

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, five clickable feature elements were surfaced on the homepage. Clicking on any of these 5 elements launched an Instastory-like short 10 second video in full screen. These videos explained the key features of the software being offered. Impact on lead generation was measured.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 339 on Expertinstitute.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Ardit Veliu    Feb 23, 2021 Test link

Find Out How It Did With 8,388 Visitors

  • Measured by form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, a number of use cases examples were added to illustrate the situations in which experts could help. 

Get Access To See The Test Results

Replaced

Isolated

Test # 116 on Homewarrantyrevi... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name S. S.    Oct 01, 2017 Test link

Find Out How It Did With 5,581 Visitors

  • Measured by visits to next page

  • Measured by form completion on next screen

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Home & Landing

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.