35 Tests By Andrey Andreev

  Head of Internet Merchandising     Website

Tests

Test #666 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2026 Desktop X.X% Sales

Andrey Tested Pattern #34: Open In A New Tab On Online.metro-cc.ru

Pattern #34: Open In A New Tab - Variant A
Pattern #34: Open In A New Tab - Variant B

This experiment ran on search results page of an ecommerce grocery store.

50% of users saw product cards that upon clicking would open in the same window (Control).

The other 50% saw product cards that upon clicking would open in a new tab/window (Treatment).

Impact on adds to cart and orders was measured.

We should also add that this experiment was run as part of the Trustworthy Replication Project and only "adds-to-cart" were pre-registered as the primary metric - https://osf.io/yu4gm/overview

Total Sample: 655,042 • Statistical Power at 5% MDE: 99.9%

Test #658 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 30, 2026 Desktop X.X% Sales

Andrey Tested Pattern #92: Already Viewed Label On Online.metro-cc.ru

Pattern #92: Already Viewed Label - Variant A
Pattern #92: Already Viewed Label - Variant B

In this experiment, users who viewed a product and then visited a listing or search results page, saw "Recently Viewed" badges on top of the corresponding product tiles. Impact on adds to cart and sales was measured.

Total Sample: 980,372 • Statistical Power at 5% MDE: 80.5%

Test #649 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 23, 2026 Desktop Mobile X.X% Progression

Andrey Tested Pattern #141: Square or Rounded Buttons On Online.metro-cc.ru

Pattern #141: Square or Rounded Buttons - Variant A
Pattern #141: Square or Rounded Buttons - Variant B

In this experiment, square buttons were changed to rounded ones throughout the full site. Impact on adds-to-cart was measured.

Total Sample: 9,171,836 • Statistical Power at 5% MDE: 99.9%

Test #648 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Apr 28, 2026 Desktop Mobile X.X% Sales

Andrey Tested Pattern #82: Onboarding Callouts On Online.metro-cc.ru

Pattern #82: Onboarding Callouts - Variant A
Pattern #82: Onboarding Callouts - Variant B

In this experiment, a red dot was added to the login link, along with a hover state that clarified the benefits of doing so. Impact on adds to cart and sales was measured.

Total Sample: 1,752,311 • Statistical Power at 5% MDE: 79.6%

Test #637 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Feb 26, 2026 Mobile X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

In this experiment, the sorting link (defaulting to popular) was swapped with the filter one. In the control, the sorting appeared on the left with the filter on the right, whereas in the variation these two were flipped. Impact on adds to cart and sales were measured.

Total Sample: 169,951 • Statistical Power at 5% MDE: 14.5%

Test #632 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 30, 2026 Desktop Mobile X.X% Sales

Andrey Tested Pattern #65: Add More For Extra Incentive On Online.metro-cc.ru

Pattern #65: Add More For Extra Incentive - Variant A
Pattern #65: Add More For Extra Incentive - Variant B

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.

Total Sample: 36,284 • Statistical Power at 5% MDE: 86.7%

Test #625 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 23, 2025 Desktop Mobile X.X% Sales

Andrey Tested Pattern #90: Out Of Stock Or In Stock Products On Online.metro-cc.ru

Pattern #90: Out Of Stock Or In Stock Products - Variant A
Pattern #90: Out Of Stock Or In Stock Products - Variant B

In this experiment, search results and listing pages received two additional filters to remove out-of-stock and in-store-only items. This reduced the number of results shown by default. The impact on add-to-cart actions, checkout flows, and completed sales was measured.

Total Sample: 220,773 • Statistical Power at 5% MDE: 42.6%

Test #620 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Nov 24, 2025 Desktop X.X% Sales

Andrey Tested Pattern #42: Countdown Timer On Online.metro-cc.ru

Pattern #42: Countdown Timer - Variant A
Pattern #42: Countdown Timer - Variant B

In this experiment, 96 hours before the end of a promotion, a countdown timer was displayed on the desktop with a 80/20 split. Also excluded new users. Impact on sales was measured.

Total Sample: 170,153 • Statistical Power at 5% MDE: 71.2%

Test #615 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Oct 28, 2025 Mobile X.X% Sales

Andrey Tested Pattern #64: Tunnel On Online.metro-cc.ru

Pattern #64: Tunnel - Variant A
Pattern #64: Tunnel - Variant B

In this experiment, two sets of distractions were removed from the checkout put. First, the search bar was removed from the top of the screen. Second, a series of app links were also removed from the bottom of the screen near the footer. Impact on checkouts was measured.

Total Sample: 206,500 • Statistical Power at 5% MDE: 99.9%

Test #613 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 30, 2025 Desktop X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, a series of brand logos with links to product listing pages were added - enabling another layer of search. Impact on products purchased was measured.

Total Sample: 1,716,300 • Statistical Power at 5% MDE: 99.9%

Test #606 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 22, 2025 Mobile X.X% Sales

Andrey Tested Pattern #4: Testimonials On Online.metro-cc.ru

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, the presence of customer reviews were A/B tested on product pages of an online grocery store. Impact on adds to cart and sales was measured. (The expert was ran as a reverse/removal, but was inverted here to match the pattern).

Total Sample: 1,317,945 • Statistical Power at 5% MDE: 79.3%

Test #601 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 22, 2025 Desktop X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 4 selling points were added at the top of product details pages. Clicking on them would launch a modal with more details.

Total Sample: 481,189 • Statistical Power at 5% MDE: 42.8%

Test #596 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 24, 2025 Desktop X.X% Sales

Andrey Tested Pattern #7: Social Counts On Online.metro-cc.ru

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, products with 10 or more purchases within the recent week showed the number of customers that bought it as a social proof element. Impact on adds to cart and purchases was measured.

Total Sample: 64,535 • Statistical Power at 5% MDE: 8.8%

Test #590 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev May 15, 2025 Desktop X.X% Sales

Andrey Tested Pattern #45: Benefit Bar On Online.metro-cc.ru

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment, 4 selling points were added at the top of the homepage. Clicking on them would launch a modal with more details.

Total Sample: 275,410 • Statistical Power at 5% MDE: 38.8%

Test #582 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Mar 22, 2025 Desktop Mobile X.X% Sales

Andrey Tested Pattern #77: Filled Or Ghost Buttons On Online.metro-cc.ru

Pattern #77: Filled Or Ghost Buttons - Variant A
Pattern #77: Filled Or Ghost Buttons - Variant B

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

Total Sample: 1,242,470 • Statistical Power at 5% MDE: 89.1%

Test #573 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jan 28, 2025 Mobile X.X% Sales

Andrey Tested Pattern #41: Sticky Call To Action On Online.metro-cc.ru

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating "Place order" button was added to a mobile shopping cart screen. Impact on progression (to checkout) and sales was measured.

Total Sample: 6,527 • Statistical Power at 5% MDE: 41.6%

Test #567 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Dec 18, 2024 Mobile Desktop X.X% Sales

Andrey Tested Pattern #135: Product Categories On Online.metro-cc.ru

Pattern #135: Product Categories - Variant A
Pattern #135: Product Categories - Variant B

In this experiment, the variation added popular categories with links at the top of the homepage. This was done for all sets of user segments: new and returning. Impact on transactions was measured.

Total Sample: 474,550 • Statistical Power at 5% MDE: 22.6%

Test #553 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Sep 27, 2024 Mobile Desktop X.X% Revenue

Andrey Tested Pattern #69: Autodiscounting On Online.metro-cc.ru

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

Test #550 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Aug 14, 2024 Mobile X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

Total Sample: 312,289 • Statistical Power at 5% MDE: 35.2%

Test #541 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jul 10, 2024 Desktop X.X% Sales

Andrey Tested Pattern #137: Visible Filters On Online.metro-cc.ru

Pattern #137: Visible Filters - Variant A
Pattern #137: Visible Filters - Variant B

In this experiment, some side column filters were made more visible by being automatically expanded. These included: brand, price and country of manufacturing.

Total Sample: 346,378 • Statistical Power at 5% MDE: 97.4%