7 Tests By Alex James

  Senior UX Manager   Twitter

Tests

Test #341 by Alex JamesAlex James Feb 25, 2021 Desktop Mobile X.X% Signups

Alex Tested Pattern #35: Floating Labels

Pattern #35: Floating Labels - Variant A
Pattern #35: Floating Labels - Variant B

This experiment shows a comparison between floating-field labels vs top-aligned labels. Form labels first appeared inline and as users would begin typing, they floated to the top of the field. In the other version, fixed field labels were shown above the form fields at all times. Impact on signups was measured.
Total Sample: 579,148 • Statistical Power at 5% MDE: 99.9%

Test #256 by Alex JamesAlex James Aug 23, 2019 Desktop Mobile X.X% Signups

Alex Tested Pattern #109: Required Field Labels

Pattern #109: Required Field Labels - Variant A
Pattern #109: Required Field Labels - Variant B

The original had no fields marked as required. The variant had all fields marked as required with an asterisk (and a reference note).
Total Sample: 116,470 • Statistical Power at 5% MDE: 75.4%

Test #242 by Alex JamesAlex James May 27, 2019 Desktop Mobile X.X% Signups

Alex Tested Pattern #7: Social Counts

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B
Total Sample: 79,012 • Statistical Power at 5% MDE: 56.8%

Test #236 by Alex JamesAlex James Apr 04, 2019 Desktop X.X% Signups

Alex Tested Pattern #9: Multiple Steps

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.
Total Sample: 282,316 • Statistical Power at 5% MDE: 92%

Test #234 by Alex JamesAlex James Apr 01, 2019 Desktop X.X% Leads

Alex Tested Pattern #101: Search Keyword Highlighting

Pattern #101: Search Keyword Highlighting - Variant A
Pattern #101: Search Keyword Highlighting - Variant B

In this experiment, a different style for keyword highlighting was used.
Total Sample: 738,295 • Statistical Power at 5% MDE: 99.9%

Test #224 by Alex JamesAlex James Feb 11, 2019 Desktop X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

This experiment reduced the search form by removing the distance field.
Total Sample: 97,074 • Statistical Power at 5% MDE: 99.9%

Test #220 by Alex JamesAlex James Jan 18, 2019 Desktop X.X% Leads

Alex Tested Pattern #34: Open In A New Tab

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).
Total Sample: 55,703 • Statistical Power at 5% MDE: 99.9%