Pattern #65: Add More For Free Shipping

Pattern #65  Tested 3 timesFirst tested by Herman Klein Recently tested by Melina Hess on Oct 08, 2024

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Add More For Free Shipping (Variant A) Add More For Free Shipping (Variant B)

Expected Median Effects Of B

?

Progression

(3 tests)

-

Leads

-

Signups

-

Engagement

?

Sales

(3 tests)

?

Revenue

(2 tests)

-

Retention

-

Referrals

?

ANY PRIMARY

(3 tests)

Tested on

Tests

Pattern #65: Add More For Free Shipping
Was Tested On Snocks.com by Melina Hess

Replaced

Isolated

Test # 512 on Snocks.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Melina Hess    Jan 17, 2024 Test link

Find Out How It Did With 401,350 Visitors

  • Measured by adds to cart

  • Measured by Revenue Per User

  • Measured by completed transactions

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 556 on Snocks.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Melina Hess    Oct 08, 2024 Test link

Find Out How It Did With 692,708 Visitors

  • Measured by adds to cart

  • Measured by Revenue Per User

  • Measured by completed transactions

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Get Access To See The Test Results

Added

Isolated

Test # 400 Mar 06, 2022 Test link

Find Out How It Did With 3,111 Visitors

  • Measured by visits to checkout

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Shopping Cart

In this experiment, customers who were not yet eligible for free shipping (with cart amounts under $39) were presented with an encouraging message to add more and earn free shipping. Impact on progression to checkout and sales was measured.

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.