Pattern #67: Currency & Taxes

Pattern #67  Tested 2 timesFirst tested by Martin Wong Recently tested by Jakub Linowski on Apr 29, 2022

Based on 2 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Currency & Taxes (Variant A) Currency & Taxes (Variant B)

Expected Median Effects Of B

X.X%

Progression

(1 tests)

-

Leads

-

Signups

-

Engagement

X.X%

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(2 tests)

All 2 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

10.1% of 90% cumulative power target at 2% MDE from 2 tests Help replicate this with an A/B test

90%
↓
4.2% 6.2%
Checkout 1 test: X%
Product 1 test: X%

Tested on

Tests

Pattern #67: Currency & Taxes
Was Tested On Examine.com by Martin Wong

Replaced

Isolated

Test # 174 on Examine.com by Martin WongMartin Wong May 13, 2018 Test link

Find Out How It Did With 1,702 Visitors

  • Measured by thank you page visit

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Currency & Taxes - Variant A A
Currency & Taxes - Variant B B
Checkout
Statistical Power by Minimum Detectable Effect
3%0.5%
3.3%1%
4.2%2%
8.3%5%
20.7%10%
39.7%15%
61.4%20%
80%25.1%

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Confounded

Test # 408 by Jakub LinowskiJakub Linowski Apr 29, 2022 Test link

Find Out How It Did With 16,332 Visitors

  • Measured by adds to cart

  • Measured by completed sales

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Currency & Taxes - Variant A A
Currency & Taxes - Variant B B
Product
Statistical Power by Minimum Detectable Effect
3%0.5%
4%1%
6.2%2%
17.9%5%
54%10%
80%13.7%
86.4%15%
98.1%20%

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.