All Latest 631 A/B Tests

MOST RECENT TESTS

Test #399 on by Jakub LinowskiJakub Linowski Feb 27, 2022 Desktop Mobile Checkout X.X% Progression

Jakub Tested Pattern #35: Floating Labels

 - Variant A
 - Variant B

In this experiment, top-aligned field labels were tested against floating labels (with labels floating inside the form field itself).

Total Sample: 2,073 Statistical Power at 5% MDE: 29.2%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #397 on Snocks.com by Melina HessMelina Hess Feb 24, 2022 Mobile Product X.X% Revenue

Melina Tested Pattern #121: Free Shipping On Snocks.com

 - Variant A
 - Variant B

In this experiment a "Free Shipping & Returns" message was added just below the price information. 

Test #123 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Feb 11, 2022 Mobile Thank You X.X% Engagement

Rodolfo Tested Pattern #71: Personalized Next Step On Getninjas.com.br

 - Variant A
 - Variant B

In this experiment, two app download buttons were tested against a single OS personalized one. In the control, both branded App Store and Google Play buttons were shown statically. Whereas in the variation a single download (stylized consistently with site wide button styles) button was shown depending on the user's operating system. Impact on application download was measured.

Total Sample: 21,910 Statistical Power at 5% MDE: 77%

Test #395 on by Jakub LinowskiJakub Linowski Jan 31, 2022 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #52: How It Works

 - Variant A
 - Variant B

In this experiment, a How It Works section was appended on a product detail page just above product reviews.

Total Sample: 17,099 Statistical Power at 5% MDE: 15.8%

Test #5 on Busyteacher.org by Andrei ZakhareuskiAndrei Zakhareuski Jan 23, 2022 Desktop Mobile Product X.X% Sales

Andrei Tested Pattern #21: What It's Worth On Busyteacher.org

 - Variant A
 - Variant B

The variation included a simple extention of the headline to include the full dollar worth of a discounted bundle deal. 

Total Sample: 4,895 Statistical Power at 5% MDE: 4%

Test #122 on Designlab.com by Daniel ShapiroDaniel Shapiro Jan 22, 2022 Desktop Mobile Product X.X% Leads

Daniel Tested Pattern #30: Authentic Photos On Designlab.com

 - Variant A
 - Variant B

In this experiment for an online design course, the variation had an extra section with student work previews. The previews were not clickable but were added just below the fold. Impact on leads was measured by potential students requesting a syllabus through an online form throughout the long landing page.

Total Sample: 9,862 Statistical Power at 5% MDE: 7.4%

Test #393 on Snocks.com by Melina HessMelina Hess Jan 19, 2022 Mobile Shopping Cart X.X% Sales

Melina Tested Pattern #1: Remove Coupon Fields On Snocks.com

 - Variant A
 - Variant B

This experiment replaced a visible coupon field with a dynamic text link that would initially hide the form field. Only after clicking the text link would the coupon form field appear. The translation from German is "Do you have a coupon code? Click here to apply". Impact on completed transactions was measured.

Total Sample: 33,575 Statistical Power at 5% MDE: 99.9%

Test #392 on by Jakub LinowskiJakub Linowski Dec 31, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #122: Zigzag Layout

 - Variant A
 - Variant B

In this experiment, paragraph style copy was reorganized into a zig zag layout with key sections being reinforiced with copy-as-image statements. Impact on adds-to-cart and sales was measured.

Total Sample: 41,827 Statistical Power at 5% MDE: 28.5%

Test #391 on Backstage.com by Stanley ZuoStanley Zuo Dec 30, 2021 Desktop Mobile Listing X.X% Signups

Stanley Tested Pattern #82: Onboarding Callouts On Backstage.com

 - Variant A
 - Variant B

This experiment added a small nudge or callout to encourage more signups. Attention was directed towards the save function, which lead to the signup flow for anyone not signed it. Impact on signups was measured.

Total Sample: 159,569 Statistical Power at 5% MDE: 99.5%

Test #390 on Snocks.com by Melina HessMelina Hess Dec 21, 2021 Desktop Mobile Checkout X.X% Sales

Melina Tested Pattern #106: Back Buttons On Snocks.com

 - Variant A
 - Variant B

In this experiment, the variation has a "Back To Shopping Cart" link right underneath the checkout button. Impact on sales was measured.

Total Sample: 22,852 Statistical Power at 5% MDE: 97.5%

Test #389 on Svsound.com by Keenan DavisKeenan Davis Dec 16, 2021 Desktop Mobile Checkout X.X% Sales

Keenan Tested Pattern #1: Remove Coupon Fields On Svsound.com

 - Variant A
 - Variant B

In this simple experiment, a highly visible coupon field was replaced with a less visible (but clickable) link in the variation. Clicking on the link would show the coupon field. Impact on sales and revenue was measured.

Total Sample: 20,321 Statistical Power at 5% MDE: 37.2%

Test #388 on by Jakub LinowskiJakub Linowski Dec 09, 2021 Mobile Listing X.X% Sales

Jakub Tested Pattern #51: Shortcut Buttons

 - Variant A
 - Variant B

In this experiment, extra "buy now" buttons were added on a listing page. These buttons were shortcuts to an add to cart flow, whereas the "learn more" buttons lead customers to product detail pages (visible in both control and variation). Impact on adds-to-cart and sales was measured.

Total Sample: 7,051 Statistical Power at 5% MDE: 10.1%

Test #387 on by Jakub LinowskiJakub Linowski Nov 30, 2021 Mobile Listing X.X% Sales

Jakub Tested Pattern #88: Action Button

 - Variant A
 - Variant B

In this experiment, simple "Learn More" buttons were added underneath each product thumbnail. These buttons were additional triggers that linked to product detail pages on top of the existing thumbnails and product names (that also linked to the PDPs). Impact on product visits and sales was measured.

Total Sample: 7,173 Statistical Power at 5% MDE: 10%

Test #385 on Snocks.com by Samuel HessSamuel Hess Nov 25, 2021 Mobile Product X.X% Sales

Samuel Tested Pattern #63: Trust Seals On Snocks.com

 - Variant A
 - Variant B

In this experiment, a simple Amazon badge was added on a product page. The translated (Google) language read: "Since we founded snocks, our customers have always been our focus - we are constantly trying to develop further. That's why we're extremely proud that Amazon attracted attention and that they named us Sales Partner of the Year in 2019."

Total Sample: 351,255 Statistical Power at 5% MDE: 99.9%

Test #384 on Mariemur.com by Gleb HodorovskiyGleb Hodorovskiy Nov 17, 2021 Mobile Shopping Cart X.X% Sales

Gleb Tested Pattern #103: Money Back Guarantee On Mariemur.com

 - Variant A
 - Variant B

In this experiment from Conversionrate.store, a 14 day money back guarantee was added to a shopping cart of a lingerie online store. Secondary text further elaborated this with the following copy "Free returns if size doesn’t match". Impact on transactions was measured.

Total Sample: 93,248 Statistical Power at 5% MDE: 37.3%

Test #381 on Expertinstitute.com by Ardit VeliuArdit Veliu Oct 30, 2021 Desktop Mobile Home & Landing X.X% Leads

Ardit Tested Pattern #49: Above The Fold Call To Action On Expertinstitute.com

 - Variant A
 - Variant B

In this experiment, an extra button to a signup lead form was placed above the fold. In the control, the same button appeared further down on the page.

Total Sample: 2,970 Statistical Power at 5% MDE: 4.7%

Test #380 on Getninjas.com.br by Rodolfo LugliRodolfo Lugli Oct 27, 2021 Desktop Mobile Home & Landing X.X% Leads

Rodolfo Tested Pattern #21: What It's Worth On Getninjas.com.br

 - Variant A
 - Variant B

In this experimemt, the average $ gain from a performed service category was shown on a landing page. Impact on leads was measured (people who would be signing up to offer a particular service).

Total Sample: 4,347 Statistical Power at 5% MDE: 14.2%

Test #379 on Learnwithhomer.com by Stanley ZuoStanley Zuo Oct 15, 2021 Mobile Pricing X.X% Sales

Stanley Tested Pattern #112: Lower Price Frames On Learnwithhomer.com

 - Variant A
 - Variant B

In this experiment, the annual plan was standardized and framed in a monthly price context. This was more comparable with the monthly plan price above. Please also note that the annual billing price was also kept and clearly stated. Impact on overall sales and annual plan sales was measured.

Total Sample: 3,437 Statistical Power at 5% MDE: 22.3%

Test #378 on by Jakub LinowskiJakub Linowski Oct 07, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

 - Variant A
 - Variant B

Here we have an experiment with a variation that preselected an option for a club duration. The control required customers to first express the choice for how many months they would like to order a product for. Whereas the variation defaulted to 12 months from the beginning.

Impact on adds-to-cart and sales was measured. The experiment unfortunately had to be stopped early due to another embedded variation that was performing poorly. And so it does not have many transactions.

Total Sample: 2,953 Statistical Power at 5% MDE: 5.2%

Test #376 on Snocks.com by Samuel HessSamuel Hess Sep 29, 2021 Mobile Desktop Product X.X% Sales

Samuel Tested Pattern #15: Bulleted Reassurances On Snocks.com

 - Variant A
 - Variant B

In this experiment, a series of reassurances were added just below the add to cart button. These included: "free shipping", "free returns" and an "anti-hole guarantee". The test ran on the product page of an socks ecommerce company. Impact on sales was measured.

Total Sample: 136,126 Statistical Power at 5% MDE: 79.6%