All Latest 645 A/B Tests

Screen

Device

Metric

Tag

Powered for

Only Significant

p-value < 0.05

MOST RECENT TESTS

Test #564 on Hellostake.com by Louis Alston Nov 26, 2024 Desktop Mobile Home & Landing X.X% Signups

Louis Tested Pattern #114: Less Or More Visible Prices On Hellostake.com

Pattern #114: Less Or More Visible Prices - Variant A

Pattern #114: Less Or More Visible Prices - Variant B

In this a/b test, the headline was changed to reflect pricing information (informing that trades are starting at $3). Impact on progression and signups was measured.

Total Sample: 25,321 • Statistical Power at 5% MDE: 6.5%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #560 on Finn.com by Daria Kurchinskaia Oct 22, 2024 Mobile Desktop Checkout X.X% Signups

Daria Tested Pattern #46: Pay Later On Finn.com

The idea of this experiment was at least two fold. 1) the variation attempted to clarify that there is no payment today with the copy "Pay 0€ today" on the collapsed state of the payment amount. 2) clarify the payment terms with exact dates and amounts for future payments.

Total Sample: 2,052 • Statistical Power at 5% MDE: 23.3%

Test #487 on Learnwithhomer.com by Stanley Zuo Aug 10, 2023 Mobile Pricing X.X% Signups

Stanley Tested Pattern #78: Tags, Badges And Structured Information On Learnwithhomer.com

Pattern #78: Tags, Badges And Structured Information - Variant A

Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, a "save 50%" badge was replaced with a "most popular" one with the intent of encouraging more users to select the higher priced plan. Impact on total and annual trial starts was measured.

Total Sample: 19,769 • Statistical Power at 5% MDE: 16.3%

Test #417 on Cxl.com by Ognjen Bošković Jun 27, 2022 Desktop Mobile Signup X.X% Signups

Ognjen Tested Pattern #127: Vague Or Specific Benefits On Cxl.com

Pattern #127: Vague Or Specific Benefits - Variant A

Pattern #127: Vague Or Specific Benefits - Variant B

CXL ran an interesting experiment that (1) added more specificity on a newsletter subscription page as well as (2) reinforced it consistently. Most visibly, an abstract or vague headline statement (control) was changed to a benefit oriented one - hinting that subscribers will eventually receive valuable case studies. This message was further reinforced with supporting copy that explained where these case studies are obtained from along with the frequency of the delivery. This same message was also reinforced with an image of actual case studies. The call to action button was also adjusted to mimic the benefit.

Impact on newsletter signups was measured.

Total Sample: 8,974 • Statistical Power at 5% MDE: 28.4%

Test #391 on Backstage.com by Stanley Zuo Dec 30, 2021 Desktop Mobile Listing X.X% Signups

Stanley Tested Pattern #82: Onboarding Callouts On Backstage.com

Pattern #82: Onboarding Callouts - Variant A

Pattern #82: Onboarding Callouts - Variant B

This experiment added a small nudge or callout to encourage more signups. Attention was directed towards the save function, which lead to the signup flow for anyone not signed it. Impact on signups was measured.

Total Sample: 159,569 • Statistical Power at 5% MDE: 99.5%

Test #318 on Thomasnet.com by Kyle Phillips Sep 29, 2020 Desktop Mobile Content X.X% Signups

Kyle Tested Pattern #60: Repeated Bottom Call To Action On Thomasnet.com

Pattern #60: Repeated Bottom Call To Action - Variant A

Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a simple link to a newsletter signup landing page was added at the bottom of an article. The newsletter landing page then encouraged users to provide their email address for future article updates.

Total Sample: 108,360 • Statistical Power at 5% MDE: 4.8%

Test #316 on Trydesignlab.com by Daniel Shapiro Sep 24, 2020 Desktop Mobile Home & Landing X.X% Signups

Daniel Tested Pattern #22: Empowering Headline On Trydesignlab.com

Pattern #22: Empowering Headline - Variant A

Pattern #22: Empowering Headline - Variant B

In this experiment, the headline was changed to focus more on the end-goal of the UX Academy program - that of landing your first UI/UX role.

Total Sample: 25,634 • Statistical Power at 5% MDE: 25.6%

Test #315 on Backstage.com by Stanley Zuo Aug 22, 2020 Mobile Signup X.X% Signups

Stanley Tested Pattern #7: Social Counts On Backstage.com

In this experiment, a dynamic number of job postings was displayed during the signup process - reinforcing the value of signing up for membership access.

Total Sample: 43,751 • Statistical Power at 5% MDE: 22.6%

Test #276 on Umbraco.com by Lars Skjold Iversen Dec 31, 2019 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #111: Field Explanations On Umbraco.com

Pattern #111: Field Explanations - Variant A

Pattern #111: Field Explanations - Variant B

In this experiment, the idea was to move away from copy that was focusing on the needs of the company ("we need your email") towards copy that hinted at a customer benefit ("create your trial").

Total Sample: 48,811 • Statistical Power at 5% MDE: 9.4%

Test #271 on Analytics-toolkit.co... by Georgi Z. Georgiev Nov 24, 2019 Desktop Mobile Signup X.X% Signups