All Latest 633 A/B Tests

MOST RECENT TESTS

Test #346 on by Stanley ZuoStanley Zuo Mar 30, 2021 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #117: Company Logos

 - Variant A
 - Variant B

In this homepage experiment, company logos were added to the homepage. These were example clients or companies that Backstage works with and offers casting (job) listing from. Impact on the registration flow and membership checkouts was measured.

Total Sample: 221,012 Statistical Power at 5% MDE: 43.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #343 on Snocks.com by Samuel HessSamuel Hess Mar 12, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Snocks.com

 - Variant A
 - Variant B

In this experiment, the content on a product page was reorganized into a zigzagging (alternating layout) along with reinforcing photos. Impact on adds-to-cart and total sales was measured.

Total Sample: 23,865 Statistical Power at 5% MDE: 32.9%

Test #86 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Feb 28, 2021 Mobile Desktop Product X.X% Leads

Rodrigo Tested Pattern #3: Fewer Form Fields On Vivareal.com.br

 - Variant A
 - Variant B

In this experiment, the telephone field was removed from a lead form on a property page. Impact on leads was measured.

Total Sample: 101,914 Statistical Power at 5% MDE: 43.5%

Test #342 on Backstage.com by Stanley ZuoStanley Zuo Feb 28, 2021 Desktop Mobile Listing X.X% Engagement

Stanley Tested Pattern #25: Nagging Results On Backstage.com

 - Variant A
 - Variant B

In this experiment, a registration wall was added on a listing page of casting call profiles. The registration wall appeared after the first 9 listings or so and encouraged users to sign up. Impact on registrations was measured, along with an engagement metric of "posting a job".

Total Sample: 7,934 Statistical Power at 5% MDE: 5.9%

Test #341 on by Alex JamesAlex James Feb 25, 2021 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #35: Floating Labels

 - Variant A
 - Variant B

This experiment shows a comparison between floating-field labels vs top-aligned labels. Form labels first appeared inline and as users would begin typing, they floated to the top of the field. In the other version, fixed field labels were shown above the form fields at all times. Impact on signups was measured.

Total Sample: 579,148 Statistical Power at 5% MDE: 99.9%

Test #338 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 29, 2021 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #63: Trust Seals On Umbraco.com

 - Variant A
 - Variant B

In this experiment, the variation added three G2 badges or awards. The intent was to measure the impact of this change on signups for Umbraco.

Total Sample: 8,133 Statistical Power at 5% MDE: 5.5%

Test #336 on Backstage.com by Stanley ZuoStanley Zuo Jan 28, 2021 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #51: Shortcut Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, a listing page was expanded to show two actions (apply and view details) instead of a single one (view details only). This variation enabled users with a shortcut action to apply for roles one step earlier (and start membership flows for new users). 

Total Sample: 159,634 Statistical Power at 5% MDE: 16.1%

Test #337 on Backstage.com by Stanley ZuoStanley Zuo Jan 28, 2021 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #51: Shortcut Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, a listing page was expanded to show two actions (apply and view details) instead of a single one (view details only). In the variant, the "view detail" links were replaced with "apply links" starting a job application (and membership flows) sooner. 

Total Sample: 159,693 Statistical Power at 5% MDE: 16.1%

Test #335 on by Jakub LinowskiJakub Linowski Jan 27, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #32: Condensed List

 - Variant A
 - Variant B

The variation here has more condensed product tiles being shown on a homepage. Two pieces of information were removed: product descriptions and past selections. Impact on product page visits and total sales was measured.

Total Sample: 20,943 Statistical Power at 5% MDE: 19.2%

Test #334 on Thomasnet.com by Kyle PhillipsKyle Phillips Jan 25, 2021 Desktop Mobile Global X.X% Progression

Kyle Tested Pattern #2: Icon Labels On Thomasnet.com

 - Variant A
 - Variant B

This experiment measured the impact of adding text labels to three icon-only nav items. 

Total Sample: 60,466 Statistical Power at 5% MDE: 11.1%

Test #333 on Expertinstitute.com by Ardit VeliuArdit Veliu Dec 31, 2020 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #11: Gradual Reassurance On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, the variation broke up a lead form into two parts. In the first step users were asked for their state followed by a standard contact form on a second step. All of the states were shown as selectable options. In the control version, the landing page only showed a button which lead to the full form. The experiment measured impact on lead form submissions.

Total Sample: 11,258 Statistical Power at 5% MDE: 6.1%

Test #331 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this little experiment, an extra "Free Shipping" message was added on a product page. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 96,962 Statistical Power at 5% MDE: 83.6%

Test #332 on by Jakub LinowskiJakub Linowski Dec 30, 2020 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #121: Free Shipping

 - Variant A
 - Variant B

In this experiment, an extra "Free Shipping" message was added on a product page - at the top of the buy box with an add-to-cart call to action. It's prominence was increased by using white copy on a darker blue background. Impact on adds-to-cart and total sales was measured.

Total Sample: 97,277 Statistical Power at 5% MDE: 83.7%

Test #329 on Snocks.com by Samuel HessSamuel Hess Dec 23, 2020 Mobile Home & Landing X.X% Sales

Samuel Tested Pattern #14: Exposed Menu Options On Snocks.com

 - Variant A
 - Variant B

In this homepage experiment, a series of product categories were shown more visible near the top of the screen (instead of only being shown inside the hamburger menu). They linked up to corresponding listing pages with such items as: gifts, short socks, long socks, and underwear. Impact on adds-to-cart and total sales was measured.

Total Sample: 58,462 Statistical Power at 5% MDE: 40.4%

Test #328 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 21, 2020 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #60: Repeated Bottom Call To Action On Umbraco.com

 - Variant A
 - Variant B

In this experiment, a trial signup section was added at the bottom of Umbraco's long homepage (CMS business). The experiment measured the impact on trial signups.

Total Sample: 57,371 Statistical Power at 5% MDE: 8.4%

Test #98 on 3dhubs.com by Rob DraaijerRob Draaijer Nov 30, 2020 Desktop Mobile Listing X.X% Leads

Rob Tested Pattern #24: Visible Availability On 3dhubs.com

 - Variant A
 - Variant B

In this experiment, the variation showed a listing's owner online status as a badge, instead of showing their average "response time". More specifically, an "Online Now" badge was shown beside individual listings of a 3D printing marketplace site. The experiment measured completed quote / lead requests (a few steps further).

Total Sample: 48,771 Statistical Power at 5% MDE: 44%

Test #326 on Thomasnet.com by Kyle PhillipsKyle Phillips Nov 25, 2020 Desktop Mobile Content X.X% Progression

Kyle Tested Pattern #41: Sticky Call To Action On Thomasnet.com

 - Variant A
 - Variant B

In this simple experiment on an article page, the variation slid out a sticky call to action linking to the next article. The sliding interaction triggered after some scrolling threshold (around 1000px or so). Afterwards, the sticky call to action maintained its floating position. The experiment measured clicks on this "next article" button.

Total Sample: 7,999 Statistical Power at 5% MDE: 4.1%

Test #324 on by Jakub LinowskiJakub Linowski Oct 30, 2020 Desktop Mobile Product X.X% Revenue

Jakub Tested Pattern #17: Least Or Most Expensive First

 - Variant A
 - Variant B

This experiment tested the order of purchase plans. The control version sorted the purchase options by the least expensive while the variation sorted them by the most expensive first. Impact on sales and revenue was measured.

Test #323 on Backstage.com by Stanley ZuoStanley Zuo Oct 29, 2020 Mobile Signup X.X% Sales

Stanley Tested Pattern #117: Company Logos On Backstage.com

 - Variant A
 - Variant B

In this experiment, the variation replaced a text testimonial with high-profile production companies that have cast with Backstage. The logos were shown during the signup and checkout flow.

Total Sample: 23,626 Statistical Power at 5% MDE: 13.9%

Test #322 on Thomasnet.com by Kyle PhillipsKyle Phillips Oct 27, 2020 Desktop Mobile Product X.X% Signups

Kyle Tested Pattern #82: Onboarding Callouts On Thomasnet.com

 - Variant A
 - Variant B

This experiment variation prompted users to save (bookmark) a company profile on a company detail page. Clicking on the save feature while logged out, would prompt a registration modal. Hence the save feature acted as an extra reason to signup. The number of people engaging or interacting with the feature was measured, as well as registrations.

Total Sample: 279,729 Statistical Power at 5% MDE: 23.6%