Pattern #108: Frequently Asked Questions

Pattern #108  Tested 2 timesTested by Jakub Linowski on Apr 27, 2023

Based on 2 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Frequently Asked Questions (Variant A) Frequently Asked Questions (Variant B)

Expected Median Effects Of B

?

Progression

(1 tests)

-

Leads

-

Signups

-

Engagement

?

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(2 tests)

Tested on

Tests

Pattern #108: Frequently Asked Questions
Was Tested by Jakub Linowski

Added

Isolated

Test # 344 by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Jakub Linowski    Mar 11, 2021 Test link

Find Out How It Did With 18,871 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Checkout

Three common delivery questions were answered at the bottom of a checkout page. 

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 467 by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Jakub Linowski    Apr 27, 2023 Test link

Find Out How It Did With 24,703 Visitors

  • Measured by adds to cart

  • Measured by completed purchases

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, an FAQ section was added near the bottom of a long product page. The reviews were collapsed by default, but expandable upon clicking. Impact on adds-to-cart and sales was measured.

Get Access To See The Test Results

Leaks

Leak #20 from Netflix.com   |   Aug 22, 2019 Home & Landing

Netflix Finally Succeeds With These 3 Tested Home Page Patterns

A - Jul 22, 2019
B - Jul 22, 2019 IMPLEMENTED

If you might recall, some of the recent Netflix homepage experiments weren't so positive as seen here and here. Today however we finally detected what might be considered a successful roll out decision of one variation tested over a month ago. Gladly Netflix doesn't give up. Here are the 3 core changes which we think might have influenced a positive outcome. View Leak

+0.5 Evidence

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.