All Latest 639 A/B Tests

MOST RECENT TESTS

Test #556 on Snocks.com by Melina HessMelina Hess Oct 08, 2024 Mobile Product X.X% Sales

Melina Tested Pattern #65: Add More For Extra Incentive On Snocks.com

 - Variant A
 - Variant B

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Total Sample: 692,708 Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #555 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)

Total Sample: 534,185 Statistical Power at 5% MDE: 36%

Test #553 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 27, 2024 Mobile Desktop Checkout X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

Test #550 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2024 Mobile Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

 - Variant A
 - Variant B

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

Total Sample: 312,289 Statistical Power at 5% MDE: 35.2%

Test #548 on Livefresh.de by Melina HessMelina Hess Aug 13, 2024 Desktop Mobile Product X.X% Sales

Melina Tested Pattern #17: Least Or Most Expensive First On Livefresh.de

 - Variant A
 - Variant B

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

Total Sample: 272,793 Statistical Power at 5% MDE: 88.8%

Test #547 on Aboalarm.de by Katharina LayKatharina Lay Aug 12, 2024 Mobile Signup X.X% Sales

Katharina Tested Pattern #6: Customer Star Ratings On Aboalarm.de

 - Variant A
 - Variant B

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

Total Sample: 102,221 Statistical Power at 5% MDE: 94.9%

Test #543 on by Jakub LinowskiJakub Linowski Jul 22, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

In this experiment, social proof copy was added just below product photos. The copy emphasied that "3 million satisfied customers" and "10 million deliveries since 2003". Impact on sales was measured.

Total Sample: 36,948 Statistical Power at 5% MDE: 18.8%

Test #540 on Finn.com by Maksim Meged Maksim Meged Jun 28, 2024 Mobile Listing X.X% Sales

Maksim Tested Pattern #136: Earliest Availability On Finn.com

 - Variant A
 - Variant B

In this experiment, the earliest availability dates were displayed underneath product tiles on listing pages. This was a/b tested on a car rental service website. Impact on product adds-to-cart as well as transactions was measured.

Total Sample: 47,251 Statistical Power at 5% MDE: 5.6%

Test #538 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jun 20, 2024 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #77: Filled Or Ghost Buttons On Volders.de

 - Variant A
 - Variant B

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

Total Sample: 56,025 Statistical Power at 5% MDE: 99.8%

Test #537 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 19, 2024 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a simple product category link was added on product detail pages. These links linked to listing pages with more of a similar product type. Impact on sales was measured.

Total Sample: 100,360 Statistical Power at 5% MDE: 24.4%

Test #536 on by Jakub LinowskiJakub Linowski Jun 14, 2024 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #28: Easiest Fields First

 - Variant A
 - Variant B

In this experiment, the order of the checkout flow was rearranged. In the control the first step of the checkout flow started with the shipping information step, followed by greeting card selection. In the variation this was rearranged (hypothesis was that the greeting card step was easier). Impact on sales was measured.

Total Sample: 9,626 Statistical Power at 5% MDE: 58.3%

Test #532 on Finn.com by Maksim Meged Maksim Meged May 10, 2024 Mobile Listing X.X% Sales

Maksim Tested Pattern #76: Infinite Scrolling Or Pagination On Finn.com

 - Variant A
 - Variant B

In this experiment, infinite scrolling was a/b tested against a paginated one.

Total Sample: 87,859 Statistical Power at 5% MDE: 8.3%

Test #531 on Aboalarm.de by Katharina LayKatharina Lay May 03, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #128: Standard Or Superscript Price Format On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

Total Sample: 175,677 Statistical Power at 5% MDE: 99.3%

Test #530 on by Stanley ZuoStanley Zuo Apr 30, 2024 Desktop Mobile X.X% Signups

Stanley Tested Pattern #28: Easiest Fields First On

 - Variant A
 - Variant B

In this experiment, the order of two signup pages was tested: plan selection vs account creation. Here we have the account creation step first in the control and the the plan selection step first in the variation. (I flipped these around to match the pattern). Impact on signups was measured.

Total Sample: 16,691 Statistical Power at 5% MDE: 5%

Test #529 on Jared.com by Craig KistlerCraig Kistler Apr 29, 2024 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Jared.com

 - Variant A
 - Variant B

In this experiment, conversational filters were tested at the top of some listing pages. Instead of showing one set of product filters, customers were shown three sets of product questions. After selecting each answer, product results would narrow and update further down on the page. Impact on adds to cart and sales were measured.

Total Sample: 189,872 Statistical Power at 5% MDE: 7%

Test #528 on 686.com by Adan ArchilaAdan Archila Apr 26, 2024 Mobile Listing X.X% Sales

Adan Tested Pattern #120: Supporting Theme Images On 686.com

 - Variant A
 - Variant B

In this experiment, the effect of having additional static category themed images was tested on category listing pages. Impact on sales was measured.

Total Sample: 216,092 Statistical Power at 5% MDE: 35.2%

Test #527 on by Jakub LinowskiJakub Linowski Apr 23, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #132: One Time Payment Copy

 - Variant A
 - Variant B

In this experiment, copy related to payment duration types (paid in full or ongoing) was changed. In the the control, one of the option used the "Pay in Full" copy, whereas the variation changed this to "One-time payment". Impact on sales was measured.

Total Sample: 26,447 Statistical Power at 5% MDE: 13.4%

Test #526 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Apr 17, 2024 Desktop Mobile Global X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a higher contrast search bar with a blue border and a filled blue button style was tested against a more feint style.  Impact on searches and purchases was measured. (A/B test was inverted to B/A in order to fit the filled-vs-ghost button pattern).

Total Sample: 896,009 Statistical Power at 5% MDE: 55.3%

Test #525 on by Jakub LinowskiJakub Linowski Mar 27, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

 - Variant A
 - Variant B

In this experiment, a club subscription duration was preselected to 6 in the variation. The control had no club durations preselected. As a result of preselecting a club duration, a more visible price also appeared at the top (sooner in the variation). Impact on sales was measured.

Total Sample: 15,627 Statistical Power at 5% MDE: 11.2%

Test #524 on Jared.com by Craig KistlerCraig Kistler Mar 26, 2024 Mobile Listing X.X% Revenue

Craig Tested Pattern #79: Product Highlights On Jared.com

 - Variant A
 - Variant B

In this experiment, additional (discounted) products were shown at the top of category listing pages with a link to see more such products ("View All Price Drops"). Impact on overall sales was measured.