All Latest 645 A/B Tests

MOST RECENT TESTS

Test #542 on Expertinstitute.com by Ardit VeliuArdit Veliu Jul 17, 2024 Desktop Home & Landing X.X% Leads

Ardit Tested Pattern #108: Frequently Asked Questions On Expertinstitute.com

Pattern #108: Frequently Asked Questions - Variant A
Pattern #108: Frequently Asked Questions - Variant B

In this experiment, a Frequently Asked Questions section was added near the bottom of a short lead gen form. This test ran on one of Expert Institute's landing pages for their expert witness seeking services. Impact on leads was measured.

Total Sample: 8,476 • Statistical Power at 5% MDE: 10.6%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #541 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 10, 2024 Desktop Listing X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

Total Sample: 346,378 • Statistical Power at 5% MDE: 97.4%

Test #539 on Snocks.com by Melina HessMelina Hess Jun 24, 2024 Desktop Global X.X% Sales

Melina Tested Pattern #135: Product Categories On Snocks.com

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, two different navigation defaults were tested against each other. In one version we can see 1) more popular products with 2) more categorical granularity being shown in the expanded state. In the other version we see "new products" being shown as the default (with a lot fewer product subcategories) to choose from.

Total Sample: 1,075,901 • Statistical Power at 5% MDE: 99.9%

Test #538 on Volders.de by Daria KurchinskaiaDaria Kurchinskaia Jun 20, 2024 Desktop Mobile Checkout X.X% Sales

Daria Tested Pattern #77: Filled Or Ghost Buttons On Volders.de

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, a less visible (ghost button style) legal confirmation box, was tested against a more visible one (filled state with higher contrast). Impact on error rates (from submitting an incomplete form) and sales was measured.

Total Sample: 56,025 • Statistical Power at 5% MDE: 99.8%

Test #537 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 19, 2024 Desktop Mobile Product X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, a simple product category link was added on product detail pages. These links linked to listing pages with more of a similar product type. Impact on sales was measured.

Total Sample: 100,360 • Statistical Power at 5% MDE: 24.4%

Test #536 by Jakub LinowskiJakub Linowski Jun 14, 2024 Desktop Mobile Checkout X.X% Sales

Jakub Tested Pattern #28: Easiest Fields First

Pattern #28: Easiest Fields First - Variant A
Pattern #28: Easiest Fields First - Variant B

In this experiment, the order of the checkout flow was rearranged. In the control the first step of the checkout flow started with the shipping information step, followed by greeting card selection. In the variation this was rearranged (hypothesis was that the greeting card step was easier). Impact on sales was measured.

Total Sample: 9,626 • Statistical Power at 5% MDE: 58.3%

Test #535 on 686.com by Adan ArchilaAdan Archila May 31, 2024 Desktop Listing X.X% Sales

Adan Tested Pattern #120: Supporting Theme Images On 686.com

Pattern #120: Supporting Theme Images - Variant A
Pattern #120: Supporting Theme Images - Variant B

In this experiment, a static category theme image at the top of a listing page was tested against the same page but without the extra image. Impact on sales was measured.

Total Sample: 79,626 • Statistical Power at 5% MDE: 22.8%

Test #534 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 28, 2024 Desktop Global X.X% Sales

Andrey Tested Pattern #82: Onboarding Callouts On Online.metro-cc.ru

Pattern #82: Onboarding Callouts - Variant A
Pattern #82: Onboarding Callouts - Variant B

In this site wide experiment, logged out customers were directed to sign in with the help of a top navigation callout. The experiment was triggered for anyone who saw the callout message. After signing in, the user would 1) remain on the same screen they were on and 2) the top header slightly changed to show a logged in state (with their orders, favorites and active username). Impact on successful logins and overall purchases was measured.

Total Sample: 1,817,890 • Statistical Power at 5% MDE: 99.6%

Test #533 by Jakub LinowskiJakub Linowski May 23, 2024 Desktop Global X.X% Sales

Jakub Tested Pattern #94: Visible Search

Pattern #94: Visible Search - Variant A
Pattern #94: Visible Search - Variant B

In this experiment, the presence of a search bar was tested against no search bar altogether. The control had search, and in the variation it was removed. The variation also exposed items from within the "Need Help?" menu, making "My account", "Contact Us" and "FAQ" more prominent.

(Here the AB test is inverted / flipped to match the pattern). 

Total Sample: 70,933 • Statistical Power at 5% MDE: 27.4%

Test #531 on Aboalarm.de by Katharina LayKatharina Lay May 03, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #128: Standard Or Superscript Price Format On Aboalarm.de

Pattern #128: Standard Or Superscript Price Format - Variant A
Pattern #128: Standard Or Superscript Price Format - Variant B

In this experiment, the font of the euro cents amount was made smaller. Additional copy was also added underneath the price reinforcing that tax was already included in the price. Impact on transactions was measured.

Total Sample: 175,677 • Statistical Power at 5% MDE: 99.3%

Test #530 on by Stanley ZuoStanley Zuo Apr 30, 2024 Desktop Mobile X.X% Signups

Stanley Tested Pattern #28: Easiest Fields First On

Pattern #28: Easiest Fields First - Variant A
Pattern #28: Easiest Fields First - Variant B

In this experiment, the order of two signup pages was tested: plan selection vs account creation. Here we have the account creation step first in the control and the the plan selection step first in the variation. (I flipped these around to match the pattern). Impact on signups was measured.

Total Sample: 16,691 • Statistical Power at 5% MDE: 5%

Test #529 on Jared.com by Craig KistlerCraig Kistler Apr 29, 2024 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Jared.com

Pattern #55: Conversational Filters - Variant A
Pattern #55: Conversational Filters - Variant B

In this experiment, conversational filters were tested at the top of some listing pages. Instead of showing one set of product filters, customers were shown three sets of product questions. After selecting each answer, product results would narrow and update further down on the page. Impact on adds to cart and sales were measured.

Total Sample: 189,872 • Statistical Power at 5% MDE: 7%

Test #527 by Jakub LinowskiJakub Linowski Apr 23, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #132: One Time Payment Copy

Pattern #132: One Time Payment Copy - Variant A
Pattern #132: One Time Payment Copy - Variant B

In this experiment, copy related to payment duration types (paid in full or ongoing) was changed. In the the control, one of the option used the "Pay in Full" copy, whereas the variation changed this to "One-time payment". Impact on sales was measured.

Total Sample: 26,447 • Statistical Power at 5% MDE: 13.4%

Test #526 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Apr 17, 2024 Desktop Mobile Global X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, a higher contrast search bar with a blue border and a filled blue button style was tested against a more feint style.  Impact on searches and purchases was measured. (A/B test was inverted to B/A in order to fit the filled-vs-ghost button pattern).

Total Sample: 896,009 • Statistical Power at 5% MDE: 55.3%

Test #525 by Jakub LinowskiJakub Linowski Mar 27, 2024 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #119: Unselected Or Selected Defaults

Pattern #119: Unselected Or Selected Defaults - Variant A
Pattern #119: Unselected Or Selected Defaults - Variant B

In this experiment, a club subscription duration was preselected to 6 in the variation. The control had no club durations preselected. As a result of preselecting a club duration, a more visible price also appeared at the top (sooner in the variation). Impact on sales was measured.

Total Sample: 15,627 • Statistical Power at 5% MDE: 11.2%

Test #522 on 686.com by Adan ArchilaAdan Archila Mar 18, 2024 Desktop Listing X.X% Sales

Adan Tested Pattern #37: List Or Grid View On 686.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B

In this desktop experiment, 4 product tiles per page (control) were tested against 6. Impact on sales was measured.

Total Sample: 79,626 • Statistical Power at 5% MDE: 22%

Test #519 on Volders.de by Katharina LayKatharina Lay Feb 23, 2024 Desktop Mobile Checkout X.X% Sales

Katharina Tested Pattern #134: Optional or Confident Recommendation On Volders.de

Pattern #134: Optional or Confident Recommendation - Variant A
Pattern #134: Optional or Confident Recommendation - Variant B

In this experiment, copy around an upsell was changed from using "optional" to "our recommendation for you". The idea was to recommend two upsells with more confidence. Impact on the two upsells (secure, and express) as well as overall transactions was measured.

Total Sample: 58,597 • Statistical Power at 5% MDE: 99.9%

Test #517 on Aboalarm.de by Daria KurchinskaiaDaria Kurchinskaia Feb 12, 2024 Desktop Checkout X.X% Sales

Daria Tested Pattern #78: Tags, Badges And Structured Information On Aboalarm.de

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

Total Sample: 127,712 • Statistical Power at 5% MDE: 94.9%

Test #515 by Jakub LinowskiJakub Linowski Jan 31, 2024 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #69: Autodiscounting

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

In this experiment, people who saw an offer (in an email or popup) would see a more visible site wide reinforcement of their earned discount being active. In the control, the discount was only shown during checkout. In the variation, it was shown throughout the web site on the homepage and product detail pages.

Total Sample: 2,471 • Statistical Power at 5% MDE: 8.5%

Test #514 on Backstage.com by Stanley ZuoStanley Zuo Jan 24, 2024 Desktop Listing X.X% Sales

Stanley Tested Pattern #97: Bigger Form Fields On Backstage.com

Pattern #97: Bigger Form Fields - Variant A
Pattern #97: Bigger Form Fields - Variant B

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

Total Sample: 164,436 • Statistical Power at 5% MDE: 21%