Pattern #62: Urgent Next Day Delivery

Pattern #62  Tested 3 timesFirst tested by Marlies Wilms Floet Recently tested by Matthew Curry on Mar 27, 2018

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Urgent Next Day Delivery (Variant A) Urgent Next Day Delivery (Variant B)

Expected Median Effects Of B

?

Progression

(1 tests)

-

Leads

-

Signups

-

Engagement

?

Sales

(3 tests)

?

Revenue

(1 tests)

-

Retention

-

Referrals

?

ANY PRIMARY

(3 tests)

Tested on

Tests

Pattern #62: Urgent Next Day Delivery
Was Tested On Missetam.nl by Marlies Wilms Floet

Added

Isolated

Test #136 on Missetam.nl by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Marlies Wilms Floet    Dec 18, 2017 Test link

Find Out How It Did

  • Measured by successful sales

De Nieuwe Zaak (a Dutch ecommerce agency) tested a countdown timer on an ecommerce site. The variation showed how many hours and minutes were left in order to be eligible for next day delivery. The variation beat the control which did not have this element of urgency.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test #163 on Lovehoney.co.uk by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Matthew Curry    Mar 27, 2018 Test link

Find Out How It Did

  • Measured by visits to a thank you page

  • Measured by average order value

Get Access To See The Test Results

Added

Isolated

Test #157 on Bobandlush.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Viljo Vabrit    Mar 06, 2018 Test link

Find Out How It Did With 1,877 Visitors

  • Measured by adds to cart

  • Measured by visits to thank you page

Hypothesis - Urgency leads to higher conversions as people have less time to think and will instead follow their impulse to complete the purchase now rather than later.

The Treatment - From Monday to Friday, before 4 PM, we added the urgency message “Free next business day delivery if you order before 4 PM (UK)”. We placed the urgency message just below the product name ensuring that it fell into the reading pattern of all visitors interested in the products. To ensure the treatment was only shown at the right time and for the right people we added a condition: MON, TUE, WED, THU, FRI before 4 PM; UK IP.

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.