All Latest 644 A/B Tests

Test #287 on Goodui.org by Jakub LinowskiJakub Linowski Mar 04, 2020 Desktop Mobile Pricing X.X% Progression

Jakub Tested Pattern #117: Company Logos On Goodui.org

Pattern #117: Company Logos - Variant A
Pattern #117: Company Logos - Variant B

In this experiment, a handful of customers and contributors from GoodUI were added on a pricing page to test the effect on sales.

Total Sample: 6,021 • Statistical Power at 5% MDE: 4.4%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #286 on Volders.de by Alexander KriegerAlexander Krieger Feb 28, 2020 Desktop Mobile Home & Landing X.X% Progression

Alexander Tested Pattern #9: Multiple Steps On Volders.de

Pattern #9: Multiple Steps - Variant A
Pattern #9: Multiple Steps - Variant B

In this experiment, a long contract cancellation landing page (control) was broken down into 4 steps with 1 final summary step (variation).

Total Sample: 67,999 • Statistical Power at 5% MDE: 75.6%

Test #285 on Ibood.com by Lukas JorissenLukas Jorissen Feb 27, 2020 Desktop Product X.X% Progression

Lukas Tested Pattern #7: Social Counts On Ibood.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, realtime social proof information has been added below an add-to-cart button. The variation shows how many users that have viewed, or placed a product into their basket. Translated to "4 visitors have this product in their shopping cart."

Total Sample: 137,190 • Statistical Power at 5% MDE: 36.7%

Test #284 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 19, 2020 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #78: Tags, Badges And Structured Information On Thomasnet.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, structured data tags were displayed on a listing page to help potential buyers make better decisions. The additional information about the listed companies included: annual revenue, employee count, and year of establishment.

Total Sample: 241,428 • Statistical Power at 5% MDE: 13%

Test #282 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 07, 2020 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #51: Shortcut Buttons On Thomasnet.com

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this experiment, a contact button was added to a listing / search results page to make it faster to contact a company. This same button was also visible on the company detail page.

Total Sample: 163,317 • Statistical Power at 5% MDE: 9.7%

Test #281 on Backstage.com by Stanley ZuoStanley Zuo Jan 31, 2020 Desktop Listing X.X% Progression

Stanley Tested Pattern #116: Links Or Buttons On Backstage.com

Pattern #116: Links Or Buttons - Variant A
Pattern #116: Links Or Buttons - Variant B

In this experiment, multiple view detail links for a listing tile were turned into higher contrast buttons. 

Total Sample: 386,439 • Statistical Power at 5% MDE: 99.2%

Test #280 on Volders.de by Alexander KriegerAlexander Krieger Jan 24, 2020 Desktop Mobile Signup X.X% Progression

Alexander Tested Pattern #3: Fewer Form Fields On Volders.de

Pattern #3: Fewer Form Fields - Variant A
Pattern #3: Fewer Form Fields - Variant B

In this experiment on a contract cancellation funnel, one field was removed - a secondary contract ID. The control and variation both had a primary "customer ID" with which to identify and cancel someone's contract with.

Total Sample: 24,301 • Statistical Power at 5% MDE: 43.6%

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Progression

Lars Tested Pattern #79: Product Highlights On Umbraco.com

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 • Statistical Power at 5% MDE: 3.7%

Test #278 by Someone Someone Jan 15, 2020 Mobile Shopping Cart X.X% Progression

Someone Tested Pattern #64: Tunnel

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, multiple elemenets were removed from the bottom of the cart page. This was done to see if they were potential distractions that hindered the purchase process. The elements included such things as: Order details (visible on other pages), large product photo, a "what you receive" section with selling points, more reassurances, and a newsletter subscribe box.

Total Sample: 1,369 • Statistical Power at 5% MDE: 12%

Test #270 on Dentalplans.com by J.R. HernandezJ.R. Hernandez Nov 19, 2019 Desktop Listing X.X% Progression

J.R. Tested Pattern #37: List Or Grid View On Dentalplans.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B

In this experiment, a list view was tested against a grid view.

Total Sample: 264,000 • Statistical Power at 5% MDE: 48.1%

Test #269 on Thomasnet.com by Julian GaviriaJulian Gaviria Nov 15, 2019 Desktop Home & Landing X.X% Progression

Julian Tested Pattern #14: Exposed Menu Options On Thomasnet.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

In this experiment, the variation exposed 6 of the options from the pulldown menu as tabs.

Total Sample: 6,168 • Statistical Power at 5% MDE: 6.7%

Test #268 on Backstage.com by Stanley ZuoStanley Zuo Nov 08, 2019 Mobile Listing X.X% Progression

Stanley Tested Pattern #14: Exposed Menu Options On Backstage.com

Pattern #14: Exposed Menu Options - Variant A
Pattern #14: Exposed Menu Options - Variant B

The change in this experiment was an exposed SEO panel (B) with a number of clickable filter options. 

Total Sample: 208,456 • Statistical Power at 5% MDE: 97%

Test #267 on Backstage.com by Stanley ZuoStanley Zuo Nov 05, 2019 Mobile Checkout X.X% Progression

Stanley Tested Pattern #99: Progress Bar On Backstage.com

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.

Total Sample: 8,552 • Statistical Power at 5% MDE: 6%

Test #266 by Someone Someone Oct 25, 2019 Desktop Mobile Product X.X% Progression

Someone Tested Pattern #4: Testimonials

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a product page showed customer reviews at the bottom of the page (B) instead of hiding them under a tab (A).

Total Sample: 17,139 • Statistical Power at 5% MDE: 15.4%

Test #264 on Kenhub.com by Niels HapkeNiels Hapke Oct 05, 2019 Desktop Mobile Global X.X% Progression

Niels Tested Pattern #41: Sticky Call To Action On Kenhub.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment users saw a sticky bar advertising the benefits of a Premium account across the bottom of the website, wherever they navigate. The sticky call to action appeared with a 4 second delay and was floating.

Total Sample: 50,572 • Statistical Power at 5% MDE: 20.3%

Test #262 on Thomasnet.com by Julian GaviriaJulian Gaviria Oct 03, 2019 Desktop Mobile Listing X.X% Progression

Julian Tested Pattern #32: Condensed List On Thomasnet.com

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

In this experiment, the B version condensed the company listings. This was done by showing less of the description and introducing a "more" and "less" dynamic links that would expand and collapse the description.

Total Sample: 105,732 • Statistical Power at 5% MDE: 8.6%

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Progression

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #40 on Adoramapix.com by Herman KleinHerman Klein Aug 13, 2019 Desktop Product X.X% Progression

Herman Tested Pattern #85: Benefit Button On Adoramapix.com

Pattern #85: Benefit Button - Variant A
Pattern #85: Benefit Button - Variant B

In this experiment only the button label changed. The control had a more immediate (next step-oriented) button label of "Upload Your Photos Now". The variation tried a more benefit-oriented button of "Order Now" (hinting at paying and obtaining the product).

Total Sample: 13,454 • Statistical Power at 5% MDE: 43.7%

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 • Statistical Power at 5% MDE: 47.9%

Test #244 on Mt.com by Vito MediavillaVito Mediavilla Jun 06, 2019 Desktop Product X.X% Progression

Vito Tested Pattern #49: Above The Fold Call To Action On Mt.com

Pattern #49: Above The Fold Call To Action - Variant A
Pattern #49: Above The Fold Call To Action - Variant B

A product landing page with an image was tested against one without - raising the call to action above the fold.

Total Sample: 3,711 • Statistical Power at 5% MDE: 11.2%