All Latest 644 A/B Tests

MOST RECENT TESTS

Test #380 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Oct 27, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #21: What It's Worth On Getninjas.com.br

Pattern #21: What It's Worth - Variant A
Pattern #21: What It's Worth - Variant B

In this experimemt, the average $ gain from a performed service category was shown on a landing page. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,347 • Statistical Power at 5% MDE: 14.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #374 on Expertinstitute.com by Ardit VeliuArdit Veliu Sep 15, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #9: Multiple Steps On Expertinstitute.com

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a lead form with numerous fields shown all at once, was broken down into 3 steps. The first step only asked for a Specialty choice that expanded into a list of options. Impact on full form completions was measured.

Total Sample: 5,628 • Statistical Power at 5% MDE: 7.5%

Test #369 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Aug 05, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #7: Social Counts On Getninjas.com.br

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experimemt, the number of service requests per month were shown that people can expect after signing up in a given category. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,256 • Statistical Power at 5% MDE: 14%

Test #368 on Mvideo.ru by Andrey AndreevAndrey Andreev Aug 02, 2021 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, popular categories were added at the bottom of a long ecommerce homepage. Impact on total sales was measured.

Total Sample: 2,278,698 • Statistical Power at 5% MDE: 99.9%

Test #358 on Preply.com by Gleb HodorovskiyGleb Hodorovskiy Jun 03, 2021 Desktop Home & Landing X.X% Sales

Gleb Tested Pattern #58: Full Height False Bottom On Preply.com

Pattern #58: Full Height False Bottom - Variant A
Pattern #58: Full Height False Bottom - Variant B

In this experiment, the header section of the homepage drastically focused around the call to action. This was done by removing elements and forcing a false bottom.

Total Sample: 133,252 • Statistical Power at 5% MDE: 14.8%

Test #356 on Mvideo.ru by Andrey AndreevAndrey Andreev May 29, 2021 Desktop Mobile Home & Landing X.X% Sales

Andrey Tested Pattern #135: Product Categories On Mvideo.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, popular search terms were added at the bottom of a long e-commerce homepage. Hence, the variation showed additional search triggers that lead to results pages. (Translated from Russian using Google Translate)

Total Sample: 5,469,900 • Statistical Power at 5% MDE: 99.9%

Test #355 by Jakub LinowskiJakub Linowski May 28, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #79: Product Highlights

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, an extra product choice was added to the header of a homepage. Instead of only highlighting a set of four specific products, the option to build custom variety one, was added.

Total Sample: 26,902 • Statistical Power at 5% MDE: 30.7%

Test #351 on Baremetrics.com by Brian SierakowskiBrian Sierakowski Apr 30, 2021 Desktop Mobile Home & Landing X.X% Signups

Brian Tested Pattern #11: Gradual Reassurance On Baremetrics.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, static integration logos were replaced with selectable ones that reassured users to signup. After clicking an integration logo, a comparison chart would appear showing how Baremetrics improves upon a selected payment processor, along with a call to signup. Impact on signups was measured.

Total Sample: 24,416 • Statistical Power at 5% MDE: 7%

Test #348 on Flukenetworks.com by Marika FranciscoMarika Francisco Apr 22, 2021 Desktop Home & Landing X.X% Progression

Marika Tested Pattern #97: Bigger Form Fields On Flukenetworks.com

Pattern #97: Bigger Form Fields - Variant A
Pattern #97: Bigger Form Fields - Variant B

In this simple experiment, the size of the "Get Quote" button in the top navigation was increased. 

Total Sample: 39,992 • Statistical Power at 5% MDE: 4.3%

Test #347 by Jakub LinowskiJakub Linowski Apr 07, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

Pattern #26: Cart Reminder And Recently Viewed - Variant A
Pattern #26: Cart Reminder And Recently Viewed - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 • Statistical Power at 5% MDE: 15.8%

Test #346 by Stanley ZuoStanley Zuo Mar 30, 2021 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #117: Company Logos

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this homepage experiment, company logos were added to the homepage. These were example clients or companies that Backstage works with and offers casting (job) listing from. Impact on the registration flow and membership checkouts was measured.

Total Sample: 221,012 • Statistical Power at 5% MDE: 43.1%

Test #345 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Mar 29, 2021 Desktop Home & Landing X.X% Leads

Rodolfo Tested Pattern #9: Multiple Steps On Getninjas.com.br

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a single long form was broken into at least 3 steps. 

Total Sample: 401,145 • Statistical Power at 5% MDE: 99.9%

Test #339 on Expertinstitute.com by Ardit VeliuArdit Veliu Feb 23, 2021 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #33: Example Situations On Expertinstitute.com

Pattern #33: Example Situations - Variant A
Pattern #33: Example Situations - Variant B

In this experiment, a number of use cases examples were added to illustrate the situations in which experts could help. 

Total Sample: 8,388 • Statistical Power at 5% MDE: 7.6%

Test #338 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 29, 2021 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #63: Trust Seals On Umbraco.com

Pattern #63: Trust Seals - Variant A
Pattern #63: Trust Seals - Variant B

In this experiment, the variation added three G2 badges or awards. The intent was to measure the impact of this change on signups for Umbraco.

Total Sample: 8,133 • Statistical Power at 5% MDE: 5.5%

Test #335 by Jakub LinowskiJakub Linowski Jan 27, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #32: Condensed List

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

The variation here has more condensed product tiles being shown on a homepage. Two pieces of information were removed: product descriptions and past selections. Impact on product page visits and total sales was measured.

Total Sample: 20,943 • Statistical Power at 5% MDE: 19.2%

Test #333 on Expertinstitute.com by Ardit VeliuArdit Veliu Dec 31, 2020 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #11: Gradual Reassurance On Expertinstitute.com

Pattern #11: Gradual Reassurance - Variant A
Pattern #11: Gradual Reassurance - Variant B

In this experiment, the variation broke up a lead form into two parts. In the first step users were asked for their state followed by a standard contact form on a second step. All of the states were shown as selectable options. In the control version, the landing page only showed a button which lead to the full form. The experiment measured impact on lead form submissions.

Total Sample: 11,258 • Statistical Power at 5% MDE: 6.1%

Test #329 on Snocks.com by Samuel HessSamuel Hess Dec 23, 2020 Mobile Home & Landing X.X% Sales

Samuel Tested Pattern #14: Exposed Menu Options On Snocks.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this homepage experiment, a series of product categories were shown more visible near the top of the screen (instead of only being shown inside the hamburger menu). They linked up to corresponding listing pages with such items as: gifts, short socks, long socks, and underwear. Impact on adds-to-cart and total sales was measured.

Total Sample: 58,462 • Statistical Power at 5% MDE: 40.4%

Test #328 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 21, 2020 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #60: Repeated Bottom Call To Action On Umbraco.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, a trial signup section was added at the bottom of Umbraco's long homepage (CMS business). The experiment measured the impact on trial signups.

Total Sample: 57,371 • Statistical Power at 5% MDE: 8.4%

Test #10 on Tradegecko.com by Syed AtiF HusainSyed AtiF Husain Nov 30, 2020 Desktop Home & Landing X.X% Leads

Syed AtiF Tested Pattern #10: Postponed Modal Forms On Tradegecko.com

Pattern #10: Postponed Modal Forms - Variant A
Pattern #10: Postponed Modal Forms - Variant B

In this experiment, 3 form fields were removed (postponed to a next step) from the homepage leaving only a "Start Trail" button. When users clicked on the "Start A Free 14 Day Trial" button, in both the control and variation they've seen the same next registration page with all of the fields. The registration page repeated the same fields with their corresponding values, as well as asked for a password as an extra field. The experiment measured successful leads.

Total Sample: 6,529 • Statistical Power at 5% MDE: 5.7%

Test #316 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Sep 24, 2020 Desktop Mobile Home & Landing X.X% Signups

Daniel Tested Pattern #22: Empowering Headline On Trydesignlab.com

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B

In this experiment, the headline was changed to focus more on the end-goal of the UX Academy program - that of landing your first UI/UX role.

Total Sample: 25,634 • Statistical Power at 5% MDE: 25.6%