Your filter results

Only Significant A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

Test #518 on by Jakub Linowski   Feb 14, 2024 Mobile Checkout

Jakub Linowski Tested Pattern #64: Tunnel In Test #518

This was an experiment on the first checkout step where users would enter shipping information. The control had a longer footer with more additional sitewide links and a call to action to a newsletter. The variation removed these elements and kept the focus on the shipping information task. Impact on progression to next step and sales was measured.

Test #517 on Aboalarm.de by Daria Kurchinskaia   Feb 12, 2024 Desktop Checkout

Daria Kurchinskaia Tested Pattern #78: Tags, Badges And Structured Information In Test #517 On Aboalarm.de

In this experiment, a "most popular" badge ("am beliebsten") was appended to the middle plan of a contract cancellation service. Impact on overall purchases and revenue was measured.

Test #516 on 686.com by Adan Archila   Feb 05, 2024 Mobile Listing

Adan Archila Tested Pattern #37: List Or Grid View In Test #516 On 686.com

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

Test #515 on by Jakub Linowski   Jan 31, 2024 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #69: Autodiscounting In Test #515

In this experiment, people who saw an offer (in an email or popup) would see a more visible site wide reinforcement of their earned discount being active. In the control, the discount was only shown during checkout. In the variation, it was shown throughout the web site on the homepage and product detail pages.

Test #514 on Backstage.com by Stanley Zuo   Jan 24, 2024 Desktop Listing

Stanley Zuo Tested Pattern #97: Bigger Form Fields In Test #514 On Backstage.com

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

Test #513 on Dripl.de by Jona Eisenberger   Jan 23, 2024 Mobile Desktop Product

Jona Eisenberger Tested Pattern #15: Bulleted Reassurances In Test #513 On Dripl.de

In this experiment of a floor cleaning product, a reassurance about product uses was appended to two cleaning agent upsells. In the control users saw the 2 standard upsells for laminate and tiles. And in the variation the copy "Right for me. 100x Cleanings" (uses) was appended. 

Test #512 on Snocks.com by Melina Hess   Jan 17, 2024 Mobile Product

Melina Hess Tested Pattern #65: Add More For Free Shipping In Test #512 On Snocks.com

In this experiment, free shipping was a/b tested against free shipping with a 40€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

Test #511 on Online.metro-cc.ru by Andrey Andreev   Jan 09, 2024 Desktop Home & Landing

Andrey Andreev Tested Pattern #79: Product Highlights In Test #511 On Online.metro-cc.ru

In this experiment, popular products were shown at the top of the homepage. Impact to sale was measured.

Test #510 on Formelskin.de by Alexander Krieger   Dec 21, 2023 Mobile Home & Landing

Alexander Krieger Tested Pattern #26: Cart Reminder And Recently Viewed In Test #510 On Formelskin.de

In this experiment, users that did not complete a purchase and came back to the homepage were shown two different experiences. In the control, users would see the homepage (essentially having to restart the purchase flow). Whereas, in the variation, users would be shown a "Welcome Back" summary view with the completed steps shown as completed and a quick resume button to the next incomplete step. Impact on completed sales was measured.

Test #509 on Jared.com by Craig Kistler   Dec 18, 2023 Desktop Product

Craig Kistler Tested Pattern #66: Complementary Upsell In Test #509 On Jared.com

In this experiment, a protection plan was launched as a modal for customers that clicked add-to-cart without choosing the upsell. Impact on adds-to-cart and sales was measured.

Test #508 on Online.metro-cc.ru by Andrey Andreev   Dec 15, 2023 Mobile Product

Andrey Andreev Tested Pattern #93: Auto Next In Test #508 On Online.metro-cc.ru

In this experiment, the variation transformed an add-to-cart button into a shopping cart one (making it a two step process). The control had an interaction where an add-to-cart button would become a quantity selection and then a shopping cart action (a three step process). In a way, the control kept users in a "dead-end" quantity selection middle state that required clicking the back button to continue the sale. Whereas the variation automatically moved users into the next step (closer towards being able to make a purchase). Impact on sales was measured. 

Test #507 on Fairment.de by Jona Eisenberger   Dec 11, 2023 Mobile Listing

Jona Eisenberger Tested Pattern #133: Product Availability In Test #507 On Fairment.de

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.

Test #506 on by Jakub Linowski   Dec 07, 2023 Desktop Mobile Product

Jakub Linowski Tested Pattern #4: Testimonials In Test #506

In this experiments, reinforcing section tiles were replaced with additional customer testimonials. Impact on adds to cart and sales was measured.

Test #505 on Shmoodyapp.com by Michael McSweeney   Nov 28, 2023 Mobile Signup

Michael McSweeney Tested Pattern #52: How It Works In Test #505 On Shmoodyapp.com

In this experiment, new paywall copy and messaging was used to encourage more users to signup and pay for access to a mental health app. The variation reinforced that users would be receiving a full featured application, with reminders about the upcoming billing. It reinforced that users will have a full week to decide and potentially cancel their application. Impact on lagging +7 day later transactions was measured.

Test #504 on Volders.de by Michal Fiech   Nov 17, 2023 Desktop Mobile Pricing

Michal Fiech Tested Pattern #113: More Or Fewer Plans In Test #504 On Volders.de

In this experiment, the cheapest pricing plan was removed from a set of 2 options. This only left the most expensive pricing plan as the option. Impact on sales and revenue was measured.

Test #502 on Fairment.de by Jona Eisenberger   Nov 06, 2023 Mobile Listing

Jona Eisenberger Tested Pattern #37: List Or Grid View In Test #502 On Fairment.de

In this experiment, a two column grid layout (control) was tested against single column layout (variation) with the product information shown to the right. Please note that the screenshot shows repeated products only because it's been sourced from a Figma design file. In reality, the products in the variation were equally diverse as in the control. 

(We've also flipped the A and B to match up with our grid pattern.)

Test #503 on by Jakub Linowski   Nov 05, 2023 Desktop Mobile Home & Landing

Jakub Linowski Tested Pattern #36: Fewer Or More Results In Test #503

In this experiment, instead of showing 12 products per screen (with pagination), the variation showed all 42 products on a single screen. Impact on adds to cart and completed orders was measured.

Test #501 on Volders.de by Daria Kurchinskaia   Nov 02, 2023 Desktop Mobile Pricing

Daria Kurchinskaia Tested Pattern #132: One Time Payment Copy In Test #501 On Volders.de

In this experiment, the wording "one-time payment" was appended below all three pricing plans for a contract cancelation service. Impact on orders placed was measured. (Translated from German: "Einmalige Zahlung").

Test #500 on Kayoutlet.com by Craig Kistler   Oct 25, 2023 Mobile Product

Craig Kistler Tested Pattern #7: Social Counts In Test #500 On Kayoutlet.com

This was a replication attempt similar to experiment 497. A social proof message was added below add to cart buttons on product detail pages. Impact on adds to cart and transactions was measured.

Test #499 on Shmoodyapp.com by Michael McSweeney   Oct 20, 2023 Mobile Signup

Michael McSweeney Tested Pattern #99: Progress Bar In Test #499 On Shmoodyapp.com

In this experiment, a progress bar was added to a signup flow of a mental health app. It appeared on numerous steps of a onboarding flow. Impact on signup completions and checkouts was measured.