All Latest 634 A/B Tests

Test #61 on by Someone Someone Jun 26, 2020 Desktop Checkout X.X% Sales

Someone Tested Pattern #9: Multiple Steps

 - Variant A
 - Variant B

In this experiment, a single screen checkout was turned into a series of smaller steps in variation B. This was achieved by showing fewer fields on the first step, and shifting the remaining ones into a 3 step modal popup. The experiment measured successful transactions (sales).

Total Sample: 8,886 Statistical Power at 5% MDE: 11.1%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #302 on Volders.de by Michal FiechMichal Fiech Jun 09, 2020 Desktop Mobile Signup X.X% Sales

Michal Tested Pattern #83: Progressive Fields On Volders.de

 - Variant A
 - Variant B

In this experiment a long form (A) was replaced with a progressive form interaction (B). Most of the form fields would appear in a grey-disabled style, until the prerequioste fields were first filled out.

Total Sample: 35,884 Statistical Power at 5% MDE: 51.2%

Test #299 on Backstage.com by Stanley ZuoStanley Zuo May 22, 2020 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #60: Repeated Bottom Call To Action On Backstage.com

 - Variant A
 - Variant B

In this experiment, at the bottom of a search results screen, a membership join button was added along with 3 encouraging reasons. The experiment measured membership funnel starts, as well as paid membership transactions (sales).

Total Sample: 106,791 Statistical Power at 5% MDE: 12.2%

Test #297 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 04, 2020 Desktop Home & Landing X.X% Sales

Daniel Tested Pattern #41: Sticky Call To Action On Trydesignlab.com

 - Variant A
 - Variant B

In this experiment, a sticky "Enroll" button was shown on a course landing page. The button lead to a payment funnel to allow enrolling/paying for a course. The exeperiment measured inital progression into this funnel as well as the deeper completed sales metric.

Total Sample: 19,954 Statistical Power at 5% MDE: 9.2%

Test #296 on Backstage.com by Stanley ZuoStanley Zuo Apr 30, 2020 Mobile Content X.X% Sales

Stanley Tested Pattern #23: Inline Link Nudge On Backstage.com

 - Variant A
 - Variant B

In this simple experiment, a text link to a join page was injected on an article page. The hypothesis was that more users would signup as a result of this subtle trigger.

Total Sample: 411,288 Statistical Power at 5% MDE: 11%

Test #293 on Backstage.com by Stanley ZuoStanley Zuo Apr 14, 2020 Desktop Mobile Product X.X% Sales

Stanley Tested Pattern #114: Less Or More Visible Prices On Backstage.com

 - Variant A
 - Variant B

In this experiment on a casting call site, pricing information was shown beside the application button. This change shows the effect of setting a price expectation and being more clear that the application process is not free.

Total Sample: 115,061 Statistical Power at 5% MDE: 9.3%

Test #292 on Backstage.com by Stanley ZuoStanley Zuo Apr 13, 2020 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #24: Visible Availability On Backstage.com

 - Variant A
 - Variant B

The core hypothesis of this experiment was that by showing clear availability (in green text) beside each casting call, more users would apply and become premium members. The experiment reports on two metrics: application starts (the first progression metric), and premium membership sales (measured a few steps further in the funnel).

Total Sample: 180,098 Statistical Power at 5% MDE: 16.8%

Test #290 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing X.X% Sales

Arthur Tested Pattern #14: Exposed Menu Options On Prepagent.com

 - Variant A
 - Variant B

In this experiment, a simple pulldown menu (for US state selection) was replaced with all state options shown as selectable buttons. The states were also abbreviated.

Total Sample: 26,029 Statistical Power at 5% MDE: 14.2%

Test #289 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing X.X% Sales

Arthur Tested Pattern #17: Least Or Most Expensive First On Prepagent.com

 - Variant A
 - Variant B

In this experiment, the order of pricing plans was rearranged as to show the most expensive one first.

Test #287 on Goodui.org by Jakub LinowskiJakub Linowski Mar 04, 2020 Desktop Mobile Pricing X.X% Sales

Jakub Tested Pattern #117: Company Logos On Goodui.org

 - Variant A
 - Variant B

In this experiment, a handful of customers and contributors from GoodUI were added on a pricing page to test the effect on sales.

Total Sample: 6,021 Statistical Power at 5% MDE: 4.4%

Test #286 on Volders.de by Alexander KriegerAlexander Krieger Feb 28, 2020 Desktop Mobile Home & Landing X.X% Sales

Alexander Tested Pattern #9: Multiple Steps On Volders.de

 - Variant A
 - Variant B

In this experiment, a long contract cancellation landing page (control) was broken down into 4 steps with 1 final summary step (variation).

Total Sample: 67,999 Statistical Power at 5% MDE: 75.6%

Test #285 on Ibood.com by Lukas JorissenLukas Jorissen Feb 27, 2020 Desktop Product X.X% Sales

Lukas Tested Pattern #7: Social Counts On Ibood.com

 - Variant A
 - Variant B

In this experiment, realtime social proof information has been added below an add-to-cart button. The variation shows how many users that have viewed, or placed a product into their basket. Translated to "4 visitors have this product in their shopping cart."

Total Sample: 137,190 Statistical Power at 5% MDE: 36.7%

Test #283 on Kenhub.com by Niels HapkeNiels Hapke Feb 08, 2020 Desktop Mobile Global X.X% Sales

Niels Tested Pattern #42: Countdown Timer On Kenhub.com

 - Variant A
 - Variant B

In this experiment, registered trial users were shown a 65 minute counter on multiple pages (dashboard, listing, quiz, articles) encouraging them to get a full subscription and study all content. Both A and B experiences offered the same limited content for trial users. After the 65 minutes came to an end, the B variation showed an additional "Go Premium" button on all pages, but continued to offer the same limited content.

Total Sample: 100,433 Statistical Power at 5% MDE: 56.9%

Test #281 on Backstage.com by Stanley ZuoStanley Zuo Jan 31, 2020 Desktop Listing X.X% Sales

Stanley Tested Pattern #116: Links Or Buttons On Backstage.com

 - Variant A
 - Variant B

In this experiment, multiple view detail links for a listing tile were turned into higher contrast buttons. 

Total Sample: 386,439 Statistical Power at 5% MDE: 99.2%

Test #280 on Volders.de by Alexander KriegerAlexander Krieger Jan 24, 2020 Desktop Mobile Signup X.X% Sales

Alexander Tested Pattern #3: Fewer Form Fields On Volders.de

 - Variant A
 - Variant B

In this experiment on a contract cancellation funnel, one field was removed - a secondary contract ID. The control and variation both had a primary "customer ID" with which to identify and cancel someone's contract with.

Total Sample: 24,301 Statistical Power at 5% MDE: 43.6%

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Sales

Lars Tested Pattern #79: Product Highlights On Umbraco.com

 - Variant A
 - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 Statistical Power at 5% MDE: 3.7%

Test #278 on by Someone Someone Jan 15, 2020 Mobile Shopping Cart X.X% Sales

Someone Tested Pattern #64: Tunnel

 - Variant A
 - Variant B

In this experiment, multiple elemenets were removed from the bottom of the cart page. This was done to see if they were potential distractions that hindered the purchase process. The elements included such things as: Order details (visible on other pages), large product photo, a "what you receive" section with selling points, more reassurances, and a newsletter subscribe box.

Total Sample: 1,369 Statistical Power at 5% MDE: 12%

Test #277 on Prepagent.com by Arthur SparksArthur Sparks Jan 03, 2020 Desktop Pricing X.X% Sales

Arthur Tested Pattern #115: Pricing Comparison Table On Prepagent.com

 - Variant A
 - Variant B

In this experiment, side-by-side plan features were aligned and changed to a comparison table with checkmarks for easier comparison.

Test #275 on Prepagent.com by Arthur SparksArthur Sparks Dec 31, 2019 Desktop Pricing X.X% Sales

Arthur Tested Pattern #114: Less Or More Visible Prices On Prepagent.com

 - Variant A
 - Variant B

In this experiment, all three prices of each plan were shifted higher for greater visibility.

Test #274 on by Someone Someone Dec 16, 2019 Desktop Mobile Checkout X.X% Sales

Someone Tested Pattern #1: Remove Coupon Fields

 - Variant A
 - Variant B

In this experiment, a fully visible coupon field (A) was made less visible by turning it into a default collaped link (B). Clicking on the link caused the coupon field to appear.

Total Sample: 3,851 Statistical Power at 5% MDE: 90.2%