All Latest 650 A/B Tests

New 10 tests added since your last visit

MOST RECENT TESTS

Test #10 on Tradegecko.com by Syed AtiF HusainSyed AtiF Husain Nov 30, 2020 Desktop Home & Landing X.X% Leads

Syed AtiF Tested Pattern #10: Postponed Modal Forms On Tradegecko.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B

In this experiment, 3 form fields were removed (postponed to a next step) from the homepage leaving only a "Start Trail" button. When users clicked on the "Start A Free 14 Day Trial" button, in both the control and variation they've seen the same next registration page with all of the fields. The registration page repeated the same fields with their corresponding values, as well as asked for a password as an extra field. The experiment measured successful leads.

Total Sample: 6,529 • Statistical Power at 5% MDE: 5.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #316 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Sep 24, 2020 Desktop Mobile Home & Landing X.X% Signups

Daniel Tested Pattern #22: Empowering Headline On Trydesignlab.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B

In this experiment, the headline was changed to focus more on the end-goal of the UX Academy program - that of landing your first UI/UX role.

Total Sample: 25,634 • Statistical Power at 5% MDE: 25.6%

Test #313 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Aug 19, 2020 Desktop Mobile Home & Landing X.X% Leads

Daniel Tested Pattern #11: Gradual Reassurance On Trydesignlab.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, instead of showing a single-focused lead form (for the UX Academy Program), users were asked to express a wider set of choices first (for the UX Academy or shortter set of skill-based courses). The experiment measured overall leads for both types of programs.

Total Sample: 13,231 • Statistical Power at 5% MDE: 15.7%

Test #311 on Backstage.com by Stanley ZuoStanley Zuo Aug 11, 2020 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #118: Category Images On Backstage.com

Pattern #118: Category Images - Variant A
Pattern #118: Category Images - Variant B

In this experiment, category links (linking to casting call search results) were replaced with tile images. In addition, 2 levels of categories were also replaced with a single text link for each tile. Finally, the font size of the link titles was also increased.

Total Sample: 120,519 • Statistical Power at 5% MDE: 19.7%

Test #308 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jul 23, 2020 Desktop Home & Landing X.X% Signups

Lars Tested Pattern #4: Testimonials On Umbraco.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, three testimonials were added mid way though on a CMS landing page. At the end of the customer testimonials an additional trial signup button was also added - which was also the primary metric. 

Total Sample: 107,783 • Statistical Power at 5% MDE: 12.1%

Test #305 on Volders.de by Michal FiechMichal Fiech Jun 30, 2020 Mobile Desktop Home & Landing X.X% Sales

Michal Tested Pattern #94: Visible Search On Volders.de

Pattern #94: Visible Search - Variant A
Pattern #94: Visible Search - Variant B

In this experiment, a search input field (to look for companies) along with most popular links (also company names) were displayed on the homepage of a leading contract cancellation service. The control (A) version instead had a button that sent users to a next page where the same selection could be made - only later. The measurable success criteria were the number of paid cancellations - a few steps down the funnel.

Total Sample: 10,350 • Statistical Power at 5% MDE: 10.6%

Test #297 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 04, 2020 Desktop Home & Landing X.X% Sales

Daniel Tested Pattern #41: Sticky Call To Action On Trydesignlab.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a sticky "Enroll" button was shown on a course landing page. The button lead to a payment funnel to allow enrolling/paying for a course. The exeperiment measured inital progression into this funnel as well as the deeper completed sales metric.

Total Sample: 19,954 • Statistical Power at 5% MDE: 9.2%

Test #288 on Kenhub.com by Niels HapkeNiels Hapke Mar 05, 2020 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #117: Company Logos On Kenhub.com

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, customer logos (of universities attended by students using Kenhub) were placed on a homepage. The experiment tested for the effect on registration visits, and premium subscription starts.

Total Sample: 36,420 • Statistical Power at 5% MDE: 57.2%

Test #286 on Volders.de by Alexander KriegerAlexander Krieger Feb 28, 2020 Desktop Mobile Home & Landing X.X% Sales

Alexander Tested Pattern #9: Multiple Steps On Volders.de

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a long contract cancellation landing page (control) was broken down into 4 steps with 1 final summary step (variation).

Total Sample: 67,999 • Statistical Power at 5% MDE: 75.6%

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Sales

Lars Tested Pattern #79: Product Highlights On Umbraco.com

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 • Statistical Power at 5% MDE: 3.7%

Test #276 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 31, 2019 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #111: Field Explanations On Umbraco.com

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment, the idea was to move away from copy that was focusing on the needs of the company ("we need your email") towards copy that hinted at a customer benefit ("create your trial").

Total Sample: 48,811 • Statistical Power at 5% MDE: 9.4%

Test #269 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 15, 2019 Desktop Home & Landing X.X% Signups

Julian Tested Pattern #14: Exposed Menu Options On Thomasnet.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this experiment, the variation exposed 6 of the options from the pulldown menu as tabs.

Total Sample: 6,168 • Statistical Power at 5% MDE: 6.7%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 • Statistical Power at 5% MDE: 24.3%

Test #260 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 16, 2019 Desktop Home & Landing X.X% Sales

Online Tested Pattern #45: Benefit Bar On Valkexclusief.nl

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment on Valk Exclusief's web site, a transparent overview of the benefits for booking hotels was shown. The copy translates to: "Why should you book here? - 5€ Loyalty Discount - Best Price Guarantee - Discount On Packages - No Reservation Costs. Valk is a 150 year hotel chain in the Netherlands.

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 • Statistical Power at 5% MDE: 47.9%

Test #243 on Goodui.org by Jakub LinowskiJakub Linowski Jun 05, 2019 Desktop Mobile Home & Landing X.X% Progression

Jakub Tested Pattern #77: Filled Or Ghost Buttons On Goodui.org

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, full red background buttons were changed to ghost buttons (red outline and transparent fill)

Total Sample: 25,046 • Statistical Power at 5% MDE: 22.6%

Test #239 on Volders.de by Alexander KriegerAlexander Krieger May 02, 2019 Desktop Home & Landing X.X% Progression

Alexander Tested Pattern #13: Centered Forms & Buttons On Volders.de

Pattern #13: Centered Forms & Buttons - Variant A
Pattern #13: Centered Forms & Buttons - Variant B

A contract cancellation landing page was tested for the effect of a single (wider CTA area with a left aligned button) vs two column layout (narrow CTA area with a right aligned button).

Total Sample: 1,288 • Statistical Power at 5% MDE: 7.2%

Test #238 on Suzuki.be by Karl GilisKarl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

Pattern #104: Carousel Vs Static Grid Images - Variant A
Pattern #104: Carousel Vs Static Grid Images - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #235 on Thomasnet.com by Julian GaviriaJulian Gaviria Apr 02, 2019 Desktop Mobile Home & Landing X.X% Leads

Julian Tested Pattern #102: Expanded Or Condensed Layout On Thomasnet.com

Pattern #102: Expanded Or Condensed Layout - Variant A
Pattern #102: Expanded Or Condensed Layout - Variant B

In this experiment, the layout was condensed from a taller to a shorter one.

Total Sample: 11,567 • Statistical Power at 5% MDE: 17.3%

Test #224 by Alex JamesAlex James Feb 11, 2019 Desktop Home & Landing X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

This experiment reduced the search form by removing the distance field.

Total Sample: 97,074 • Statistical Power at 5% MDE: 99.9%