All Latest 623 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #236 on by Alex James Apr 04, 2019 Desktop Signup X.X% Signups

Alex Tested Pattern #9: Multiple Steps

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Join To See Winners And Estimate Your Tests

Test #218 on Yummly.com by Kimberly Cheung Jan 14, 2019 Desktop Mobile Home & Landing X.X% Signups

Kimberly Tested Pattern #94: Visible Search On Yummly.com

Hypothesis: Anonymous users can't use global search while on the home promo page. We believe that if we show a global search bar to anonymous users, it presents a higher converting funnel (guided search) and will increase our sign-up rates significantly.

Control (A): Logged out users don't see global search bar.

Variant (B): Logged out users see global search bar. After searching for a keyword, the signup funnel starts with a more personalized reason to continue the signup process.

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Test #198 on Bomgar.com by Lee Elkins Sep 03, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #40: Blurred Product Background On Bomgar.com

Test #195 on Yummly.com by Kimberly Cheung Aug 13, 2018 Desktop Mobile Listing X.X% Signups

Kimberly Tested Pattern #78: Tags, Badges And Structured Information On Yummly.com

Test #193 on Yummly.com by Marcos Ciarrocchi Aug 07, 2018 Desktop Mobile Signup X.X% Signups

Marcos Tested Pattern #91: Forced Action On Yummly.com

In this experiment, the presence of an additional "skip all" text link was tested on a multiple step signup flow. The skip all link allowed users to bypass personalization questions and go straight to their app dashboard. The control (A) shows its presence, and in variant B we can see it was removed.

Test #189 on Yummly.com by Kimberly Cheung Jul 23, 2018 Desktop Mobile Signup X.X% Signups