Pattern #52: How It Works

Pattern #52  Tested 3 timesFirst tested by Justin Baer Recently tested by Jakub Linowski on Jan 31, 2022

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
How It Works (Variant A) How It Works (Variant B)

Expected Median Effects Of B

?

Progression

(1 tests)

?

Leads

(1 tests)

?

Signups

(1 tests)

-

Engagement

?

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(3 tests)

Tests

Pattern #52: How It Works
Was Tested On Trydesignlab.com by Will Anderson

Removed

Isolated

Test #200 on Trydesignlab.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Will Anderson    Sep 14, 2018 Test link

Find Out How It Did With 33,802 Visitors

  • Measured by completed signups

  • Measured by course enrolments (paid)

In this experiment, a "How It Works" content section was removed.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test #395 Tested on An Anonymous Site    Jan 31, 2022 Test link

Find Out How It Did With 17,099 Visitors

  • Measured by adds to cart

  • Measured by completed sales

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Get Access To See The Test Results

Added

Isolated

Test #23 on Checkineasy.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Justin Baer    Oct 01, 2015 Test link

Find Out How It Did With 4,743 Visitors

  • Measured by visits to post-signup

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.