All Latest 650 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

Test #300 on Volders.de by Michal Fiech May 25, 2020 Desktop Mobile Signup X.X% Progression

Michal Tested Pattern #3: Fewer Form Fields On Volders.de

Pattern #3: Fewer Form Fields - Variant A

Pattern #3: Fewer Form Fields - Variant B

In this experiment, a password field was removed on a contract cancellation form (Volders).

In the control version, users were required to enter their email address and a password. If the email address was associated with an existing account, then the password was used to authenticate the user (and validated). When users entered a new email address, then the password field was used to create a new account.

In the variation, the password field was removed, as the authentication happened after the conversion itself using other backend mechanisms.

Total Sample: 23,356 • Statistical Power at 5% MDE: 83.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #291 on Elevate App by Jesse Germinario Mar 30, 2020 Mobile Signup X.X% Signups

Jesse Tested Pattern #91: Forced Action

This experiment was ran on the initial onboarding screens of the Elevate App - right after installing and launching the app for the first time. The change was the removal of subtle "skip" links that fast tracked users to the signup/login screen (Get Started). Hence in the variation, all users had to scroll through the 4 introductory messages before being asked to create an account.

Total Sample: 135,631 • Statistical Power at 5% MDE: 96.6%

Test #280 on Volders.de by Alexander Krieger Jan 24, 2020 Desktop Mobile Signup X.X% Sales

Alexander Tested Pattern #3: Fewer Form Fields On Volders.de

In this experiment on a contract cancellation funnel, one field was removed - a secondary contract ID. The control and variation both had a primary "customer ID" with which to identify and cancel someone's contract with.

Total Sample: 24,301 • Statistical Power at 5% MDE: 43.6%

Test #278 by Someone Jan 15, 2020 Mobile Shopping Cart X.X% Sales

Someone Tested Pattern #64: Tunnel

In this experiment, multiple elemenets were removed from the bottom of the cart page. This was done to see if they were potential distractions that hindered the purchase process. The elements included such things as: Order details (visible on other pages), large product photo, a "what you receive" section with selling points, more reassurances, and a newsletter subscribe box.

Total Sample: 1,369 • Statistical Power at 5% MDE: 12%

Test #224 by Alex James Feb 11, 2019 Desktop Home & Landing X.X% Progression