Pattern #24: Visible Availability

Pattern #24  Tested 5 timesFirst tested by Rodrigo Maués Recently tested by Rob Draaijer on Nov 30, 2020

Based on 5 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Visible Availability (Variant A) Visible Availability (Variant B)

Expected Median Effects Of B

?

Progression

(2 tests)

?

Leads

(4 tests)

-

Signups

-

Engagement

?

Sales

(1 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(5 tests)

Tested on

Tests

Replaced

Isolated

Test #98 on 3dhubs.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rob Draaijer Rob    Nov 30, 2020 Test link

Find Out How It Performed With 48,771 Visitors

  • Measured by placed quotes

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Listing

In this experiment, the variation showed a listing's owner online status as a badge, instead of showing their average "response time". More specifically, an "Online Now" badge was shown beside individual listings of a 3D printing marketplace site. The experiment measured completed quote / lead requests (a few steps further).

Get Access To See The Test Results

Isolated

Test #99 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués Rodrigo    Sep 23, 2020 Test link

Find Out How It Performed With 249,954 Visitors

  • Measured by form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

In this experiment, a lead form on a listing page showed whether an agent was recently online or not. The diplayed had two statuses: either indicating that someone is online now, or the most recent time they were online in minutes.

Get Access To See The Test Results

Added

Isolated

Test #292 on Backstage.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo Stanley    Apr 13, 2020 Test link

Find Out How It Performed With 180,098 Visitors

  • Measured by application process starts

  • Measured by premium membership completions

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Listing

The core hypothesis of this experiment was that by showing clear availabiltiy (in green text) beside each casting call, more users would apply and become premium members. The experiment reports on two metrics: application starts (the first progression metric), and premium membership sales (merasured a few steps further in the funnel).

Get Access To See The Test Results

Added

Isolated

Test #102 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués Rodrigo    May 02, 2017 Test link

Find Out How It Performed With 250,533 Visitors

  • Measured by form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

Leaks

Leak #66 from Airbnb.com   |   Mar 18, 2021 Product

Airbnb Once Again Rejects Next Available Date Suggestions

A - Jan 21, 2021
B - Jan 19, 2021 REJECTED

Once again Airbnb a/b tested an idea of surfacing the next available dates near their calendar picker. And once again the experiment looks like it was rejected just like previously. View Leak

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.