Pattern #107: Contrast Links & Buttons

Pattern #107  Tested 1 timesTested by Julian Gaviria on Jul 30, 2019

Based on 1 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Contrast Links & Buttons (Variant A) Contrast Links & Buttons (Variant B)

Expected Median Effects Of B

-

Progression

-

Leads

-

Signups

X.X%

Engagement

(1 tests)

-

Sales

-

Revenue

-

Retention

-

Referrals

X.X%

ANY PRIMARY

(1 tests)

Tested on

Tests

Replaced

Isolated

Test # 252 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 30, 2019 Test link

Find Out How It Did With 142,102 Visitors

  • Measured by clicks on any inline link

  • XX.X% (XXX successes out of XXX,XXX visitors)
  • XX.X% (XXX successes out of XXX,XXX visitors)
Zoom In
Contrast Links & Buttons - Variant A A
Contrast Links & Buttons - Variant B B
Content
Statistical Power by Minimum Detectable Effect
4%0.5%
7.6%1%
18.2%2%
74.3%5%
80%5.4%
99.9%10%
99.9%15%
99.9%20%

In this experiment a light blue bold link was tested against a darker blue bold link. 

Get Access To See The Test Results

Leaks

Leak #16 from Google.com   |   Jul 22, 2019 Listing

Google Has Been A/B Testing Link Colors (Again) And This Light Blue Didn't Pass

A - Jun 17, 2019
B - Jun 17, 2019 REJECTED

It's been a decade since it was first discovered that Google has famously tested those 41 shades of blue. Last month I discovered that they began experimenting with link colors on their search results screen - once again. This time Google tested a lighter blue with a lower contrast which turned out that they rejected (most likely due to a negative experiment result). View Leak

+0.5 Evidence

Leak #27 from Zalando.co.uk   |   Oct 7, 2019 Product

Zalando Tests Black Add-To-Cart Buttons

A - Sep 19, 2019
B - Sep 19, 2019 IMPLEMENTED

Zalando ran a simple experiment on their product page where they challenged their existing orange add-to-cart button against a black one. One month later, the black button was rejected even though the black one had a higher contrast ratio. [UPDATE: the outcome of the experiment was flipped with black being the eventual implementation]  View Leak

+0.5 Evidence

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.