All Latest 633 A/B Tests

MOST RECENT TESTS

Test #363 on by Jakub LinowskiJakub Linowski Jul 05, 2021 Desktop Mobile Product X.X% Sales

Jakub Tested Pattern #30: Authentic Photos

 - Variant A
 - Variant B

In this experiment, six product photos from were added which showed the actual products (including unboxing images).

Total Sample: 24,655 Statistical Power at 5% MDE: 33.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #347 on by Jakub LinowskiJakub Linowski Apr 07, 2021 Desktop Mobile Home & Landing X.X% Sales

Jakub Tested Pattern #26: Cart Reminder And Recently Viewed

 - Variant A
 - Variant B

In this experiment, when customers viewed a product and returned to the homepage, they would then see the most recently viewed one - a delicate nudge. The experiment ran with full traffic and impact on sales was measured.

Total Sample: 13,749 Statistical Power at 5% MDE: 15.8%

Test #343 on Snocks.com by Samuel HessSamuel Hess Mar 12, 2021 Desktop Mobile Product X.X% Sales

Samuel Tested Pattern #122: Zigzag Layout On Snocks.com

 - Variant A
 - Variant B

In this experiment, the content on a product page was reorganized into a zigzagging (alternating layout) along with reinforcing photos. Impact on adds-to-cart and total sales was measured.

Total Sample: 23,865 Statistical Power at 5% MDE: 32.9%

Test #327 on Backstage.com by Stanley ZuoStanley Zuo Nov 26, 2020 Desktop Signup X.X% Signups

Stanley Tested Pattern #120: Supporting Theme Images On Backstage.com

 - Variant A
 - Variant B

In this experiment, an aspirational photo was shown on the right side panel - reinforcing the theme of casting calls. The experiment measured progression to the next step and completed signups.

Total Sample: 11,009 Statistical Power at 5% MDE: 53%

Test #311 on Backstage.com by Stanley ZuoStanley Zuo Aug 11, 2020 Desktop Mobile Home & Landing X.X% Sales

Stanley Tested Pattern #118: Category Images On Backstage.com

 - Variant A
 - Variant B

In this experiment, category links (linking to casting call search results) were replaced with tile images. In addition, 2 levels of categories were also replaced with a single text link for each tile. Finally, the font size of the link titles was also increased.

Total Sample: 120,519 Statistical Power at 5% MDE: 19.7%

Test #241 on Kenhub.com by Niels HapkeNiels Hapke May 24, 2019 Desktop Mobile Signup X.X% Signups

Niels Tested Pattern #105: Lead Magnets On Kenhub.com

 - Variant A
 - Variant B

In this experiment, a free study guide ebook was promoted on a registration page.

Total Sample: 63,631 Statistical Power at 5% MDE: 87.5%

Test #238 on Suzuki.be by Karl GilisKarl Gilis May 01, 2019 Desktop Home & Landing X.X% Progression

Karl Tested Pattern #104: Carousel Vs Static Grid Images On Suzuki.be

 - Variant A
 - Variant B

In this homepage experiment with a 4-slide carousel, the slides changed every 3.5 seconds and users could also choose another slide manually. In the variations, instead of the 4 slides in the carousel, static images were used to take up the same amount of space.

Test #226 on Microsoft.com by Ronny KohaviRonny Kohavi Feb 18, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #96: Single Focus Photos On Microsoft.com

 - Variant A
 - Variant B

Microsoft Store ran an experiment on the Surface Book 2 product page. The treatment showed a hero image with fewer, yet larger product photos

Test #221 on Microsoft.com by Ronny KohaviRonny Kohavi Jan 27, 2019 Desktop Product X.X% Sales

Ronny Tested Pattern #49: Above The Fold Call To Action On Microsoft.com

 - Variant A
 - Variant B

Microsoft Store ran an experiment on the Office 365 Home product page. The treatment raised the purchase calls to action higher by removing the hero image.

Test #219 on Mt.com by Vito MediavillaVito Mediavilla Jan 14, 2019 Desktop Mobile Home & Landing X.X% Leads

Vito Tested Pattern #95: Clickable Product Previews On Mt.com

 - Variant A
 - Variant B
Total Sample: 4,836 Statistical Power at 5% MDE: 11%

Test #206 on Yummly.com by Kimberly CheungKimberly Cheung Oct 25, 2018 Desktop Mobile Signup X.X% Signups

Kimberly Tested Pattern #40: Blurred Product Background On Yummly.com

 - Variant A
 - Variant B

This test ran on the first step of a multiple signup funnel and only changed the background to a blurred image.

Total Sample: 138,106 Statistical Power at 5% MDE: 77.4%

Test #198 on Bomgar.com by Lee ElkinsLee Elkins Sep 03, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #40: Blurred Product Background On Bomgar.com

 - Variant A
 - Variant B
Total Sample: 1,893 Statistical Power at 5% MDE: 21.3%

Test #126 on Rollbar.com by Mike SmithMike Smith Nov 22, 2017 Desktop Signup X.X% Signups

Mike Tested Pattern #40: Blurred Product Background On Rollbar.com

 - Variant A
 - Variant B
Total Sample: 2,205 Statistical Power at 5% MDE: 12.4%

Test #116 on Homewarrantyreviews.... by Sumantha ShankaranarayanaSumantha Shankaranarayana Oct 01, 2017 Desktop Home & Landing X.X% Leads

Sumantha Tested Pattern #33: Example Situations On Homewarrantyreviews....

 - Variant A
 - Variant B
Total Sample: 5,581 Statistical Power at 5% MDE: 8.2%

Test #63 on Vanityplanet.com by Doug BaltmanDoug Baltman Jan 01, 2017 Desktop Product X.X% Progression

Doug Tested Pattern #30: Authentic Photos On Vanityplanet.com

 - Variant A
 - Variant B
Total Sample: 6,000 Statistical Power at 5% MDE: 7.6%

Test #48 on Adoramapix.com by Herman KleinHerman Klein Oct 01, 2016 Product X.X% Sales

Herman Tested Pattern #4: Testimonials On Adoramapix.com

 - Variant A
 - Variant B
Total Sample: 19,399 Statistical Power at 5% MDE: 48.7%

Test #32 on Over-blog.com by Tael PinaultTael Pinault Apr 20, 2016 Desktop Signup X.X% Signups

Tael Tested Pattern #40: Blurred Product Background On Over-blog.com

 - Variant A
 - Variant B
Total Sample: 7,233 Statistical Power at 5% MDE: 38.1%