All Latest 645 A/B Tests

MOST RECENT TESTS

Test #535 on 686.com by Adan ArchilaAdan Archila May 31, 2024 Desktop Listing X.X% Sales

Adan Tested Pattern #120: Supporting Theme Images On 686.com

Pattern #120: Supporting Theme Images - Variant A
Pattern #120: Supporting Theme Images - Variant B

In this experiment, a static category theme image at the top of a listing page was tested against the same page but without the extra image. Impact on sales was measured.

Total Sample: 79,626 • Statistical Power at 5% MDE: 22.8%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #532 on Finn.com by Maksim Meged Maksim Meged May 10, 2024 Mobile Listing X.X% Sales

Maksim Tested Pattern #76: Infinite Scrolling Or Pagination On Finn.com

Pattern #76: Infinite Scrolling Or Pagination - Variant A
Pattern #76: Infinite Scrolling Or Pagination - Variant B

In this experiment, infinite scrolling was a/b tested against a paginated one.

Total Sample: 87,859 • Statistical Power at 5% MDE: 8.3%

Test #529 on Jared.com by Craig KistlerCraig Kistler Apr 29, 2024 Mobile Desktop Listing X.X% Sales

Craig Tested Pattern #55: Conversational Filters On Jared.com

Pattern #55: Conversational Filters - Variant A
Pattern #55: Conversational Filters - Variant B

In this experiment, conversational filters were tested at the top of some listing pages. Instead of showing one set of product filters, customers were shown three sets of product questions. After selecting each answer, product results would narrow and update further down on the page. Impact on adds to cart and sales were measured.

Total Sample: 189,872 • Statistical Power at 5% MDE: 7%

Test #528 on 686.com by Adan ArchilaAdan Archila Apr 26, 2024 Mobile Listing X.X% Sales

Adan Tested Pattern #120: Supporting Theme Images On 686.com

Pattern #120: Supporting Theme Images - Variant A
Pattern #120: Supporting Theme Images - Variant B

In this experiment, the effect of having additional static category themed images was tested on category listing pages. Impact on sales was measured.

Total Sample: 216,092 • Statistical Power at 5% MDE: 35.2%

Test #524 on Jared.com by Craig KistlerCraig Kistler Mar 26, 2024 Mobile Listing X.X% Revenue

Craig Tested Pattern #79: Product Highlights On Jared.com

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, additional (discounted) products were shown at the top of category listing pages with a link to see more such products ("View All Price Drops"). Impact on overall sales was measured.

Test #522 on 686.com by Adan ArchilaAdan Archila Mar 18, 2024 Desktop Listing X.X% Sales

Adan Tested Pattern #37: List Or Grid View On 686.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B

In this desktop experiment, 4 product tiles per page (control) were tested against 6. Impact on sales was measured.

Total Sample: 79,626 • Statistical Power at 5% MDE: 22%

Test #516 on 686.com by Adan ArchilaAdan Archila Feb 05, 2024 Mobile Listing X.X% Sales

Adan Tested Pattern #37: List Or Grid View On 686.com

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B

In this experiment, a one large product photo (control) was tested against a two-column layout with two smaller images (variation). Impact on sales was measured.

Total Sample: 216,092 • Statistical Power at 5% MDE: 34.5%

Test #514 on Backstage.com by Stanley ZuoStanley Zuo Jan 24, 2024 Desktop Listing X.X% Sales

Stanley Tested Pattern #97: Bigger Form Fields On Backstage.com

Pattern #97: Bigger Form Fields - Variant A
Pattern #97: Bigger Form Fields - Variant B

In this experiment, the click area of job listing tiles was expanded to the size of the full job tile. In the control, the click area was smaller - mostly only the job headline, along with additional "view more" links on the right hand column. Clicking the tile or headline would open up a new job details page in both control and variation. Impact on progression and membership sales was measured.

Total Sample: 164,436 • Statistical Power at 5% MDE: 21%

Test #507 on Fairment.de by Jona EisenbergerJona Eisenberger Dec 11, 2023 Mobile Listing X.X% Sales

Jona Tested Pattern #133: Product Availability On Fairment.de

Pattern #133: Product Availability - Variant A
Pattern #133: Product Availability - Variant B

In this experiment, product availabiltiy bars were shown on products with low stock. This was shown on listing pages. Impact on adds to cart and sales was measured.

Total Sample: 42,001 • Statistical Power at 5% MDE: 40.1%

Test #502 on Fairment.de by Jona EisenbergerJona Eisenberger Nov 06, 2023 Mobile Listing X.X% Sales

Jona Tested Pattern #37: List Or Grid View On Fairment.de

Pattern #37: List Or Grid View - Variant A
Pattern #37: List Or Grid View - Variant B

In this experiment, a two column grid layout (control) was tested against single column layout (variation) with the product information shown to the right. Please note that the screenshot shows repeated products only because it's been sourced from a Figma design file. In reality, the products in the variation were equally diverse as in the control. 

(We've also flipped the A and B to match up with our grid pattern.)

Total Sample: 14,417 • Statistical Power at 5% MDE: 13.6%

Test #475 on Online.metro-cc.ru by Andrey AndreevAndrey Andreev Jun 07, 2023 Desktop Mobile Listing X.X% Sales

Andrey Tested Pattern #36: Fewer Or More Results On Online.metro-cc.ru

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B

Are more (popular) product results better than none at all? In this experiment, popular products were shown during an empty search result. Impact on sales was measured.

Total Sample: 22,070 • Statistical Power at 5% MDE: 12.1%

Test #460 on Backstage.com by Stanley ZuoStanley Zuo Mar 21, 2023 Mobile Listing X.X% Sales

Stanley Tested Pattern #41: Sticky Call To Action On Backstage.com

Pattern #41: Sticky Call To Action - Variant A
Pattern #41: Sticky Call To Action - Variant B

In this experiment, a floating top navigation was shown with a "Join" button. In the control, the navigation was only visible at the top of the page. Also keep in mind that signup starts were also triggered throughout multiple CTAs throughout the page and from particular job detail pages. The a/b test ran on a listing page of Backstage - a casting call job site. Impact on signups  and checkouts was measured.

Total Sample: 1,057,325 • Statistical Power at 5% MDE: 41.8%

Test #459 on Snocks.com by Melina HessMelina Hess Feb 28, 2023 Desktop Mobile Listing X.X% Sales

Melina Tested Pattern #36: Fewer Or More Results On Snocks.com

Pattern #36: Fewer Or More Results - Variant A
Pattern #36: Fewer Or More Results - Variant B

In this listing page experiment, color sets of the same product were tested against individual products with unique colors (with additional product tiles). Essentially, the A version here contained fewer product items (with color sets), while the B version contained more results and tiles (with grouped products). Impact on total sales was measured.

(The original control and variation was inverted, but was flipped to match the fewer or more results pattern).

Total Sample: 185,702 • Statistical Power at 5% MDE: 99.2%

Test #447 on Vivareal.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Dec 23, 2022 Mobile Listing X.X% Leads

Vinicius Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional call to action (Whatsapp link) was added on a listing page of one of Brazil's largest real estate sites.In the variation the 3 calls to action include: a link that launched the phone interaction, a general contact lead form, and finally the Whatsapp link (added in the variant).  Impact on total lead starts and completions was measured.

Total Sample: 1,416,128 • Statistical Power at 5% MDE: 99.9%

Test #437 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Oct 28, 2022 Desktop Mobile Listing X.X% Leads

Rodrigo Tested Pattern #18: Single Or Alternative Buttons On Vivareal.com.br

Pattern #18: Single Or Alternative Buttons - Variant A
Pattern #18: Single Or Alternative Buttons - Variant B

In this experiment, an additional and alternative text based call to action link was added on real estate properity listings. Instead of only having "Ligar" ("Call"), "Enviar mensagem" was also appended ("Send Message"). This additional link lead to a lead-gen form. 

Total Sample: 2,595,541 • Statistical Power at 5% MDE: 99.9%

Test #396 on Depositphotos.com by Gleb HodorovskiyGleb Hodorovskiy Feb 13, 2022 Desktop Listing X.X% Revenue

Gleb Tested Pattern #124: Confirmed Selection On Depositphotos.com

Pattern #124: Confirmed Selection - Variant A
Pattern #124: Confirmed Selection - Variant B

In this experiment from Conversionrate.store, the framing of the registration message was changed from a generic account creation one to a specific image selected by the user. The experiment started on a listing page of a stock photography / illustration site. The control showed a more generic message with benefits for signing up and making the purchase. Whereas the variation repeated the actual image that customers clicked on from listing pages - establishing continuity as well as providing a reason for signing up. Impact on sales was measured.

Test #391 on Backstage.com by Stanley ZuoStanley Zuo Dec 30, 2021 Desktop Mobile Listing X.X% Signups

Stanley Tested Pattern #82: Onboarding Callouts On Backstage.com

Pattern #82: Onboarding Callouts - Variant A
Pattern #82: Onboarding Callouts - Variant B

This experiment added a small nudge or callout to encourage more signups. Attention was directed towards the save function, which lead to the signup flow for anyone not signed it. Impact on signups was measured.

Total Sample: 159,569 • Statistical Power at 5% MDE: 99.5%

Test #388 by Jakub LinowskiJakub Linowski Dec 09, 2021 Mobile Listing X.X% Sales

Jakub Tested Pattern #51: Shortcut Buttons

Pattern #51: Shortcut Buttons - Variant A
Pattern #51: Shortcut Buttons - Variant B

In this experiment, extra "buy now" buttons were added on a listing page. These buttons were shortcuts to an add to cart flow, whereas the "learn more" buttons lead customers to product detail pages (visible in both control and variation). Impact on adds-to-cart and sales was measured.

Total Sample: 7,051 • Statistical Power at 5% MDE: 10.1%

Test #387 by Jakub LinowskiJakub Linowski Nov 30, 2021 Mobile Listing X.X% Sales

Jakub Tested Pattern #88: Action Button

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this experiment, simple "Learn More" buttons were added underneath each product thumbnail. These buttons were additional triggers that linked to product detail pages on top of the existing thumbnails and product names (that also linked to the PDPs). Impact on product visits and sales was measured.

Total Sample: 7,173 • Statistical Power at 5% MDE: 10%

Test #375 on Backstage.com by Stanley ZuoStanley Zuo Sep 17, 2021 Mobile Listing X.X% Sales

Stanley Tested Pattern #32: Condensed List On Backstage.com

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

Similar to experiment 373, listing descriptions were shortened dynamically using exposable "more" links AND dates/location data was removed. This way, the variation showed shorter listings and therefore more listings per screens. Impact on listing clicks (progression) along with membership starts was measured.

Total Sample: 44,045 • Statistical Power at 5% MDE: 92.5%