All Latest 633 A/B Tests

MOST RECENT TESTS

Test #533 on by Jakub LinowskiJakub Linowski May 23, 2024 Desktop Global X.X% Sales

Jakub Tested Pattern #94: Visible Search

 - Variant A
 - Variant B

In this experiment, the presence of a search bar was tested against no search bar altogether. The control had search, and in the variation it was removed. The variation also exposed items from within the "Need Help?" menu, making "My account", "Contact Us" and "FAQ" more prominent.

(Here the AB test is inverted / flipped to match the pattern). 

Total Sample: 70,933 Statistical Power at 5% MDE: 27.4%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #531 on Aboalarm.de by Katharina LayKatharina Lay May 03, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #128: Standard Or Superscript Price Format On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

Total Sample: 175,677 Statistical Power at 5% MDE: 99.3%

Test #530 on by Stanley ZuoStanley Zuo Apr 30, 2024 Desktop Mobile X.X% Signups

Stanley Tested Pattern #28: Easiest Fields First On

 - Variant A
 - Variant B

In this experiment, the order of two signup pages was tested: plan selection vs account creation. Here we have the account creation step first in the control and the the plan selection step first in the variation. (I flipped these around to match the pattern). Impact on signups was measured.

Total Sample: 16,691 Statistical Power at 5% MDE: 5%

Test #529 on Jared.com by Craig KistlerCraig Kistler Apr 29, 2024 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Jared.com

 - Variant A
 - Variant B

In this experiment, conversational filters were tested at the top of some listing pages. Instead of showing one set of product filters, customers were shown three sets of product questions. After selecting each answer, product results would narrow and update further down on the page. Impact on adds to cart and sales were measured.

Total Sample: 189,872 Statistical Power at 5% MDE: 7%

Test #527 on by Jakub LinowskiJakub Linowski Apr 23, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #132: One Time Payment Copy

 - Variant A
 - Variant B

In this experiment, copy related to payment duration types (paid in full or ongoing) was changed. In the the control, one of the option used the "Pay in Full" copy, whereas the variation changed this to "One-time payment". Impact on sales was measured.

Total Sample: 26,447 Statistical Power at 5% MDE: 13.4%

Test #526 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Apr 17, 2024 Desktop Mobile Global X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, a higher contrast search bar with a blue border and a filled blue button style was tested against a more feint style.  Impact on searches and purchases was measured. (A/B test was inverted to B/A in order to fit the filled-vs-ghost button pattern).

Total Sample: 896,009 Statistical Power at 5% MDE: 55.3%

Test #525 on by Jakub LinowskiJakub Linowski Mar 27, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

 - Variant A
 - Variant B

In this experiment, a club subscription duration was preselected to 6 in the variation. The control had no club durations preselected. As a result of preselecting a club duration, a more visible price also appeared at the top (sooner in the variation). Impact on sales was measured.

Total Sample: 15,627 Statistical Power at 5% MDE: 11.2%

Test #522 on 686.com by Adan ArchilaAdan Archila Mar 18, 2024 Desktop Listing X.X% Sales

Adan Tested Pattern #37: List Or Grid View On 686.com

 - Variant A
 - Variant B

In this desktop experiment, 4 product tiles per page (control) were tested against 6. Impact on sales was measured.

Total Sample: 79,626 Statistical Power at 5% MDE: 22%

Test #519 on Volders.de by Katharina LayKatharina Lay Feb 23, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #134: Optional or Confident Recommendation On Volders.de

 - Variant A
 - Variant B

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

Total Sample: 58,597 Statistical Power at 5% MDE: 99.9%

Test #517 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Feb 12, 2024 Desktop Checkout X.X% Sales

Daria Tested Pattern #78: Tags, Badges And Structured Information On Aboalarm.de

 - Variant A
 - Variant B

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

Total Sample: 127,712 Statistical Power at 5% MDE: 94.9%

Test #515 on by Jakub LinowskiJakub Linowski Jan 31, 2024 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #69: Autodiscounting

 - Variant A
 - Variant B

In this experiment, people who saw an offer (in an email or popup) would see a more visible site wide reinforcement of their earned discount being active. In the control, the discount was only shown during checkout. In the variation, it was shown throughout the web site on the homepage and product detail pages.

Total Sample: 2,471 Statistical Power at 5% MDE: 8.5%

Test #514 on Backstage.com by Stanley ZuoStanley Zuo Jan 24, 2024 Desktop Listing X.X% Sales

Stanley Tested Pattern #97: Bigger Form Fields On Backstage.com

 - Variant A
 - Variant B

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

Total Sample: 164,436 Statistical Power at 5% MDE: 21%

Test #513 on Dripl.de by Jona EisenbergerJona Eisenberger Jan 23, 2024 Mobile Desktop Product X.X% Sales

Jona Tested Pattern #15: Bulleted Reassurances On Dripl.de

 - Variant A
 - Variant B

In this experiment of a floor cleaning product, a reassurance about product uses was appended to two cleaning agent upsells. In the control users saw the 2 standard upsells for laminate and tiles. And in the variation the copy "Right for me. 100x Cleanings" (uses) was appended. 

Total Sample: 69,221 Statistical Power at 5% MDE: 18.7%

Test #511 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 09, 2024 Desktop Home & Landing X.X% Sales

Andrey Tested Pattern #79: Product Highlights On Online.metro-cc.ru

 - Variant A
 - Variant B

In this experiment, popular products were shown at the top of the homepage. Impact to sale was measured.

Total Sample: 760,358 Statistical Power at 5% MDE: 99.9%

Test #509 on Jared.com by Craig KistlerCraig Kistler Dec 18, 2023 Desktop Product X.X% Sales

Craig Tested Pattern #66: Complementary Upsell On Jared.com

 - Variant A
 - Variant B

In this experiment, a protection plan was launched as a modal for customers that clicked add-to-cart without choosing the upsell. Impact on adds-to-cart and sales was measured.

Total Sample: 407,785 Statistical Power at 5% MDE: 23.2%

Test #506 on by Jakub LinowskiJakub Linowski Dec 07, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #4: Testimonials

 - Variant A
 - Variant B

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

Total Sample: 83,713 Statistical Power at 5% MDE: 47.2%

Test #504 on Volders.de by Michal FiechMichal Fiech Nov 17, 2023 Desktop Mobile Pricing X.X% Revenue

Michal Tested Pattern #113: More Or Fewer Plans On Volders.de

 - Variant A
 - Variant B

In this experiment, the cheapest pricing plan was removed from a set of 2 options. This only left the most expensive pricing plan as the option. Impact on sales and revenue was measured.

Test #503 on by Jakub LinowskiJakub Linowski Nov 05, 2023 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #36: Fewer Or More Results

 - Variant A
 - Variant B

In this experiment, instead of showing 12 products per screen (with pagination), the variation showed all 42 products on a single screen. Impact on adds to cart and completed orders was measured.

Total Sample: 3,331 Statistical Power at 5% MDE: 7.1%

Test #501 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Nov 02, 2023 Desktop Mobile Pricing X.X% Sales

Daria Tested Pattern #132: One Time Payment Copy On Volders.de

 - Variant A
 - Variant B

In this experiment, the wording "one-time payment" was appended below all three pricing plans for a contract cancelation service. Impact on orders placed was measured. (Translated from German: "Einmalige Zahlung").

Total Sample: 89,887 Statistical Power at 5% MDE: 99.9%

Test #498 on by Jakub LinowskiJakub Linowski Oct 19, 2023 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #7: Social Counts

 - Variant A
 - Variant B

In this experiment, the variation tracked how many people would add something to cart over the last 24 hours and display that just below the add to cart button. Impact on adds to cart and transactions was measured.

Total Sample: 14,539 Statistical Power at 5% MDE: 17.9%