All Latest 633 A/B Tests

MOST RECENT TESTS

Test #580 on Finn.com by Tim KarcherTim Karcher Mar 06, 2025 Mobile Signup X.X% Signups

Tim Tested Pattern #91: Forced Action On Finn.com

 - Variant A
 - Variant B

In this experiment, the control shows an (X) close option within a signup flow, whereas the variation had it removed. Clicking the close icon would collapse the signup modal and show the product page. Users were still able use the back and forward functionality.

(The test was inversed in order to fit the pattern). Impact on signups was measured.

Total Sample: 36,898 Statistical Power at 5% MDE: 99.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #576 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Mobile Listing X.X% Leads

Tim Tested Pattern #34: Open In A New Tab On Finn.com

 - Variant A
 - Variant B
Total Sample: 66,947 Statistical Power at 5% MDE: 12.5%

Test #575 on Finn.com by Tim KarcherTim Karcher Feb 12, 2025 Desktop Listing X.X% Leads

Tim Tested Pattern #34: Open In A New Tab On Finn.com

 - Variant A
 - Variant B

In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signups and sales was measured.

Total Sample: 37,497 Statistical Power at 5% MDE: 9.1%

Test #574 on Myer.com.au by Jay KimJay Kim Jan 30, 2025 Mobile Product X.X% Sales

Jay Tested Pattern #41: Sticky Call To Action On Myer.com.au

 - Variant A
 - Variant B

In this experiment published by Jay Kim, a sticky add to cart button was added on mobile product detail pages. It appeared after the scroll depth past the original add to cart button. Impact to adds to cart and completed sales was measured.

Total Sample: 524,153 Statistical Power at 5% MDE: 93.9%

Test #572 on by Deborah O'MalleyDeborah O'Malley Jan 27, 2025 Mobile Product X.X% Progression

Deborah Tested Pattern #41: Sticky Call To Action

 - Variant A
 - Variant B

In this experiment from GuessTheTest.com, the control variation only showed the primary add-to-cart button further down on the page. The variation however turned the button into a floating one once users scrolled on the page. Impact on button clicks was measured.

Total Sample: 1,320 Statistical Power at 5% MDE: 21.5%

Test #568 on by Jakub LinowskiJakub Linowski Dec 22, 2024 X.X% Sales

Jakub Tested Pattern #80: Persistent Filters

 - Variant A
 - Variant B

In this experiment, "persistence" of 4 product choices was added in the variation. When users made a product selection such as: duration, payment terms, starting month or shipping frequency, their choices were remembered and defaulted on next visits, reloads or when viewing other products. Impact on adds to cart and sales was measured.

Total Sample: 81,116 Statistical Power at 5% MDE: 39.9%

Test #566 on Banter.com by Craig KistlerCraig Kistler Dec 11, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power

Test #562 on by Jakub LinowskiJakub Linowski Nov 13, 2024 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #99: Progress Bar

 - Variant A
 - Variant B

In this experiment, a 3 step progress bar was added starting on a checkout funnel (dedicated add-to-cart page, greeting card step and order summary). The progress bar also showed any completed steps as a "checked off" state. More so, users were able to use the progress bar as a navigation item to any previously completed and currently active steps. Impact on sales was measured.

Total Sample: 2,313 Statistical Power at 5% MDE: 28.2%

Test #559 on Tourradar.com by Clemens GraveClemens Grave Oct 18, 2024 Desktop Listing X.X% Progression

Clemens Tested Pattern #137: Visible Filters On Tourradar.com

 - Variant A
 - Variant B

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

Total Sample: 36,470 Statistical Power at 5% MDE: 99.5%

Test #557 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Desktop Only)

Total Sample: 349,103 Statistical Power at 5% MDE: 23.6%

Test #558 on Obsbygg.no by Joachim FurusethJoachim Furuseth Oct 17, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obsbygg.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

Total Sample: 1,002,479 Statistical Power at 5% MDE: 33.6%

Test #555 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Mobile Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)

Total Sample: 534,185 Statistical Power at 5% MDE: 36%

Test #554 on Obs.no by Joachim FurusethJoachim Furuseth Sep 30, 2024 Desktop Product X.X% Sales

Joachim Tested Pattern #41: Sticky Call To Action On Obs.no

 - Variant A
 - Variant B

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Desktop Only)

Total Sample: 127,871 Statistical Power at 5% MDE: 14.3%

Test #553 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 27, 2024 Mobile Desktop Checkout X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

Test #551 on Tourradar.com by Clemens GraveClemens Grave Sep 04, 2024 Desktop Product X.X% Progression

Clemens Tested Pattern #139: Page Level Navigation On Tourradar.com

 - Variant A
 - Variant B

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Total Sample: 70,793 Statistical Power at 5% MDE: 99.9%

Test #550 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2024 Mobile Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

 - Variant A
 - Variant B

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

Total Sample: 312,289 Statistical Power at 5% MDE: 35.2%

Test #545 on Banter.com by Craig KistlerCraig Kistler Jul 29, 2024 Desktop Product X.X% Revenue

Craig Tested Pattern #66: Complementary Upsell On Banter.com

 - Variant A
 - Variant B

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

Sample size too small for 80% power

Test #541 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 10, 2024 Desktop Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

Total Sample: 346,378 Statistical Power at 5% MDE: 97.4%

Test #539 on Snocks.com by Melina HessMelina Hess Jun 24, 2024 Desktop Global X.X% Sales

Melina Tested Pattern #135: Product Categories On Snocks.com

 - Variant A
 - Variant B

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

Total Sample: 1,075,901 Statistical Power at 5% MDE: 99.9%

Test #537 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 19, 2024 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a simple product category link was added on product detail pages. These links linked to listing pages with more of a similar product type. Impact on sales was measured.

Total Sample: 100,360 Statistical Power at 5% MDE: 24.4%