Pattern #67: Currency & Taxes

Pattern #67  Tested 2 timesFirst tested by Martin Wong Recently tested by Jakub Linowski on Apr 29, 2022

Based on 2 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Currency & Taxes (Variant A) Currency & Taxes (Variant B)

Expected Median Effects Of B

X.X%

Progression

(1 tests)

-

Leads

-

Signups

-

Engagement

X.X%

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(2 tests)

All 2 tests meta-analyzed: +X.X% combined effect (p-val X.XXXX)

10.1% of 90% cumulative power target at 2% MDE from 2 tests Help replicate this with an A/B test

90%
↓
4.2% 6.2%
Checkout 1 test: X%
Product 1 test: X%

Tested on

Tests

Added

Confounded

Test # 408 by Jakub LinowskiJakub Linowski Apr 29, 2022 Test link

Find Out How It Did With 16,332 Visitors

  • Measured by adds to cart

  • Measured by completed sales

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Currency & Taxes - Variant A A
Currency & Taxes - Variant B B
Product
Statistical Power by Minimum Detectable Effect
3%0.5%
4%1%
6.2%2%
17.9%5%
54%10%
80%13.7%
86.4%15%
98.1%20%

Here is a very simple experiment where CDN currency copy was appended to prices being shown on a Canadian ecommerce site. Additional copy ("from Canada") was appended to an existing shipping message.  

Get Access To See The Test Results

Replaced

Isolated

Test # 174 on Examine.com by Martin WongMartin Wong May 13, 2018 Test link

Find Out How It Did With 1,702 Visitors

  • Measured by thank you page visit

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Currency & Taxes - Variant A A
Currency & Taxes - Variant B B
Checkout
Statistical Power by Minimum Detectable Effect
3%0.5%
3.3%1%
4.2%2%
8.3%5%
20.7%10%
39.7%15%
61.4%20%
80%25.1%

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.