All Latest 644 A/B Tests

MOST RECENT TESTS

Test #293 on Backstage.com by Stanley ZuoStanley Zuo Apr 14, 2020 Desktop Mobile Product X.X% Sales

Stanley Tested Pattern #114: Less Or More Visible Prices On Backstage.com

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this experiment on a casting call site, pricing information was shown beside the application button. This change shows the effect of setting a price expectation and being more clear that the application process is not free.

Total Sample: 115,061 • Statistical Power at 5% MDE: 9.3%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #292 on Backstage.com by Stanley ZuoStanley Zuo Apr 13, 2020 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #24: Visible Availability On Backstage.com

Pattern #24: Visible Availability - Variant A
Pattern #24: Visible Availability - Variant B

The core hypothesis of this experiment was that by showing clear availability (in green text) beside each casting call, more users would apply and become premium members. The experiment reports on two metrics: application starts (the first progression metric), and premium membership sales (measured a few steps further in the funnel).

Total Sample: 180,098 • Statistical Power at 5% MDE: 16.8%

Test #289 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing X.X% Revenue

Arthur Tested Pattern #17: Least Or Most Expensive First On Prepagent.com

Pattern #17: Least Or Most Expensive First - Variant A
Pattern #17: Least Or Most Expensive First - Variant B

In this experiment, the order of pricing plans was rearranged as to show the most expensive one first.

Test #290 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing X.X% Sales

Arthur Tested Pattern #14: Exposed Menu Options On Prepagent.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this experiment, a simple pulldown menu (for US state selection) was replaced with all state options shown as selectable buttons. The states were also abbreviated.

Total Sample: 26,029 • Statistical Power at 5% MDE: 14.2%

Test #288 on Kenhub.com by Niels HapkeNiels Hapke Mar 05, 2020 Desktop Mobile Home & Landing X.X% Signups

Niels Tested Pattern #117: Company Logos On Kenhub.com

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, customer logos (of universities attended by students using Kenhub) were placed on a homepage. The experiment tested for the effect on registration visits, and premium subscription starts.

Total Sample: 36,420 • Statistical Power at 5% MDE: 57.2%

Test #287 on Goodui.org by Jakub LinowskiJakub Linowski Mar 04, 2020 Desktop Mobile Pricing X.X% Sales

Jakub Tested Pattern #117: Company Logos On Goodui.org

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, a handful of customers and contributors from GoodUI were added on a pricing page to test the effect on sales.

Total Sample: 6,021 • Statistical Power at 5% MDE: 4.4%

Test #286 on Volders.de by Alexander KriegerAlexander Krieger Feb 28, 2020 Desktop Mobile Home & Landing X.X% Sales

Alexander Tested Pattern #9: Multiple Steps On Volders.de

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a long contract cancellation landing page (control) was broken down into 4 steps with 1 final summary step (variation).

Total Sample: 67,999 • Statistical Power at 5% MDE: 75.6%

Test #285 on Ibood.com by Lukas JorissenLukas Jorissen Feb 27, 2020 Desktop Product X.X% Sales

Lukas Tested Pattern #7: Social Counts On Ibood.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, realtime social proof information has been added below an add-to-cart button. The variation shows how many users that have viewed, or placed a product into their basket. Translated to "4 visitors have this product in their shopping cart."

Total Sample: 137,190 • Statistical Power at 5% MDE: 36.7%

Test #284 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 19, 2020 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #78: Tags, Badges And Structured Information On Thomasnet.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, structured data tags were displayed on a listing page to help potential buyers make better decisions. The additional information about the listed companies included: annual revenue, employee count, and year of establishment.

Total Sample: 241,428 • Statistical Power at 5% MDE: 13%

Test #283 on Kenhub.com by Niels HapkeNiels Hapke Feb 08, 2020 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #42: Countdown Timer On Kenhub.com

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

In this experiment, registered trial users were shown a 65 minute counter on multiple pages (dashboard, listing, quiz, articles) encouraging them to get a full subscription and study all content. Both A and B experiences offered the same limited content for trial users. After the 65 minutes came to an end, the B variation showed an additional "Go Premium" button on all pages, but continued to offer the same limited content.

Total Sample: 100,433 • Statistical Power at 5% MDE: 56.9%

Test #282 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 07, 2020 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #51: Shortcut Buttons On Thomasnet.com

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this experiment, a contact button was added to a listing / search results page to make it faster to contact a company. This same button was also visible on the company detail page.

Total Sample: 163,317 • Statistical Power at 5% MDE: 9.7%

Test #281 on Backstage.com by Stanley ZuoStanley Zuo Jan 31, 2020 Desktop Listing X.X% Sales

Stanley Tested Pattern #116: Links Or Buttons On Backstage.com

Pattern #116: Links Or Buttons - Variant A
Pattern #116: Links Or Buttons - Variant B

In this experiment, multiple view detail links for a listing tile were turned into higher contrast buttons. 

Total Sample: 386,439 • Statistical Power at 5% MDE: 99.2%

Test #280 on Volders.de by Alexander KriegerAlexander Krieger Jan 24, 2020 Desktop Mobile Signup X.X% Sales

Alexander Tested Pattern #3: Fewer Form Fields On Volders.de

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

In this experiment on a contract cancellation funnel, one field was removed - a secondary contract ID. The control and variation both had a primary "customer ID" with which to identify and cancel someone's contract with.

Total Sample: 24,301 • Statistical Power at 5% MDE: 43.6%

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Sales

Lars Tested Pattern #79: Product Highlights On Umbraco.com

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 • Statistical Power at 5% MDE: 3.7%

Test #277 on Prepagent.com by Arthur SparksArthur Sparks Jan 03, 2020 Desktop Pricing X.X% Revenue

Arthur Tested Pattern #115: Pricing Comparison Table On Prepagent.com

Pattern #115: Pricing Comparison Table - Variant A
Pattern #115: Pricing Comparison Table - Variant B

In this experiment, side-by-side plan features were aligned and changed to a comparison table with checkmarks for easier comparison.

Test #275 on Prepagent.com by Arthur SparksArthur Sparks Dec 31, 2019 Desktop Pricing X.X% Revenue

Arthur Tested Pattern #114: Less Or More Visible Prices On Prepagent.com

Pattern #114: Less Or More Visible Prices - Variant A
Pattern #114: Less Or More Visible Prices - Variant B

In this experiment, all three prices of each plan were shifted higher for greater visibility.

Test #276 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 31, 2019 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #111: Field Explanations On Umbraco.com

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment, the idea was to move away from copy that was focusing on the needs of the company ("we need your email") towards copy that hinted at a customer benefit ("create your trial").

Total Sample: 48,811 • Statistical Power at 5% MDE: 9.4%

Test #274 by Someone Someone Dec 16, 2019 Desktop Mobile Checkout X.X% Sales

Someone Tested Pattern #1: Remove Coupon Fields

Pattern #1: Remove Coupon Fields - Variant A
Pattern #1: Remove Coupon Fields - Variant B

In this experiment, a fully visible coupon field (A) was made less visible by turning it into a default collaped link (B). Clicking on the link caused the coupon field to appear.

Total Sample: 3,851 • Statistical Power at 5% MDE: 90.2%

Test #272 on Backstage.com by Stanley ZuoStanley Zuo Dec 03, 2019 Desktop Pricing X.X% Revenue

Stanley Tested Pattern #113: More Or Fewer Plans On Backstage.com

Pattern #113: More Or Fewer Plans - Variant A
Pattern #113: More Or Fewer Plans - Variant B

In this experiment, the three pricing plans were condensed into a single recommended plan (annual), with a secondary option to choose the monthly plan.

Test #271 on Analytics-toolkit.co... by Georgi Z. GeorgievGeorgi Z. Georgiev Nov 24, 2019 Desktop Mobile Signup X.X% Signups

Georgi Tested Pattern #4: Testimonials On Analytics-toolkit.co...

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, the test variant showed 2 testimonials on the user registration / free trial registration page at Analytics-Toolkit.com

Total Sample: 2,432 • Statistical Power at 5% MDE: 17.4%