86 Tests By Jakub Linowski

  Founder @ GoodUI     Website   Twitter

Tests

Test #363 by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

Pattern #30: Authentic Photos - Variant A
Pattern #30: Authentic Photos - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 • Statistical Power at 5% MDE: 33.9%

Test #360 by Jakub LinowskiJakub Linowski Jun 16, 2021 Desktop X.X% Sales

Jakub Tested Pattern #60: Repeated Bottom Call To Action

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a comparison chart with various purchasing options was appended at the bottom of a product page. 

Total Sample: 32,070 • Statistical Power at 5% MDE: 35.1%

Test #355 by Jakub LinowskiJakub Linowski May 28, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #79: Product Highlights

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 • Statistical Power at 5% MDE: 30.7%

Test #347 by Jakub LinowskiJakub Linowski Apr 07, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 • Statistical Power at 5% MDE: 15.8%

Test #344 by Jakub LinowskiJakub Linowski Mar 11, 2021 Desktop X.X% Sales

Jakub Tested Pattern #108: Frequently Asked Questions

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

Three common delivery questions were answered at the bottom of a checkout page. 

Total Sample: 18,871 • Statistical Power at 5% MDE: 50.1%

Test #340 by Jakub LinowskiJakub Linowski Feb 25, 2021 Desktop X.X% Sales

Jakub Tested Pattern #114: Less Or More Visible Prices

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this experiment, the variation added a second total price at the bottom of the checkout screen just above the checkout button. The impact on sales was measured.

Total Sample: 2,883 • Statistical Power at 5% MDE: 97.3%

Test #335 by Jakub LinowskiJakub Linowski Jan 27, 2021 Desktop Mobile X.X% Sales

Jakub Tested Pattern #32: Condensed List

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

The variation here has more condensed product tiles being shown on a homepage. Two pieces of information were removed: product descriptions and past selections. Impact on product page visits and total sales was measured.

Total Sample: 20,943 • Statistical Power at 5% MDE: 19.2%

Test #331 by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #121: Free Shipping

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this little experiment, an extra "Free Shipping" message was added on a product page. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 96,962 • Statistical Power at 5% MDE: 83.6%

Test #332 by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #121: Free Shipping

Pattern #121: Free Shipping - Variant A
Pattern #121: Free Shipping - Variant B

In this experiment, an extra "Free Shipping" message was added on a product page - at the top of the buy box with an add-to-cart call to action. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 97,277 • Statistical Power at 5% MDE: 83.7%

Test #324 by Jakub LinowskiJakub Linowski Oct 30, 2020 Desktop Mobile X.X% Revenue

Jakub Tested Pattern #17: Least Or Most Expensive First

Pattern #17: Least Or Most Expensive First - Variant A
Pattern #17: Least Or Most Expensive First - Variant B

This experiment tested the order of purchase plans. The control version sorted the purchase options by the least expensive while the variation sorted them by the most expensive first. Impact on sales and revenue was measured.

Test #320 by Jakub LinowskiJakub Linowski Oct 20, 2020 Desktop X.X% Sales

Jakub Tested Pattern #49: Above The Fold Call To Action

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.

Total Sample: 2,908 • Statistical Power at 5% MDE: 97.4%

Test #312 by Jakub LinowskiJakub Linowski Aug 14, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #83: Progressive Fields

Pattern #83: Progressive Fields - Variant A
Pattern #83: Progressive Fields - Variant B

In this experiment, we tested a visible "Shipping Frequency" (A) option against a progressively displayed one (B) that would only appear after someone first chose a duration option. Thus in variation B, the buy box component would initially appear with fewer fields and smaller. The experiment measured initial progression and actual sales. 

Note on the data: the experiment was run a little shorter than usual, as one of the variations triggered a stop rule to protect losses (so the effect might be somewhat inflated from a lower power).

Total Sample: 2,861 • Statistical Power at 5% MDE: 5.6%

Test #287 on Goodui.org by Jakub LinowskiJakub Linowski Mar 04, 2020 Desktop Mobile X.X% Sales

Jakub Tested Pattern #117: Company Logos On Goodui.org

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, a handful of customers and contributors from GoodUI were added on a pricing page to test the effect on sales.

Total Sample: 6,021 • Statistical Power at 5% MDE: 4.4%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 • Statistical Power at 5% MDE: 24.3%

Test #251 on Goodui.org by Jakub LinowskiJakub Linowski Jul 25, 2019 Desktop Mobile X.X% Signups

Jakub Tested Pattern #57: Maybe Later On Goodui.org

Pattern #57: Maybe Later - Variant A
Pattern #57: Maybe Later - Variant B

In this experiment, we tested a standard modal (with 2 choices) against a "Maybe Later" one (with 3 choices). One of the choices in the variant allowed users to postpone their decision with a "maybe" which would enable a floating bar at the bottom of the screen. Clicking on any of the "Yes" options would send people to the bottom of the screen with an email signup form. Increasing signup was our primary measure. Both modals also appeared instantly after a page load.

Total Sample: 7,759 • Statistical Power at 5% MDE: 7.2%

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Total Sample: 25,046 • Statistical Power at 5% MDE: 22.6%

Test #237 on Goodui.org by Jakub LinowskiJakub Linowski Apr 29, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #103: Money Back Guarantee On Goodui.org

Pattern #103: Money Back Guarantee - Variant A
Pattern #103: Money Back Guarantee - Variant B
Total Sample: 21,096 • Statistical Power at 5% MDE: 6%

Test #230 on Goodui.org by Jakub LinowskiJakub Linowski Mar 09, 2019 Desktop Mobile X.X% Engagement

Jakub Tested Pattern #56: Hover Button On Goodui.org

Pattern #56: Hover Button - Variant A
Pattern #56: Hover Button - Variant B

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Total Sample: 30,699 • Statistical Power at 5% MDE: 98.1%

Test #229 by Jakub LinowskiJakub Linowski Mar 08, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B
Total Sample: 11,214 • Statistical Power at 5% MDE: 13%

Test #228 by Jakub LinowskiJakub Linowski Mar 05, 2019 Desktop Mobile X.X% Sales

Jakub Tested Pattern #99: Progress Bar

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

The variation added a progress bar to one of the checkout steps for a ticket ordering site.

Total Sample: 12,961 • Statistical Power at 5% MDE: 14.7%