All Latest 645 A/B Tests

MOST RECENT TESTS

Test #314 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto Aug 21, 2020 Desktop Mobile Product X.X% Leads

Vinicius Tested Pattern #43: Long Titles On Zapimoveis.com.br

Pattern #43: Long Titles - Variant A
Pattern #43: Long Titles - Variant B

In this experiment, a dynamic page title was generated and added at the top of the screen. The first few words from a property description were used to dynamically generate these titles. The effect on leads was measured.

Total Sample: 6,533,516 • Statistical Power at 5% MDE: 99.9%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #308 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jul 23, 2020 Desktop Home & Landing X.X% Signups

Lars Tested Pattern #4: Testimonials On Umbraco.com

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, three testimonials were added mid way though on a CMS landing page. At the end of the customer testimonials an additional trial signup button was also added - which was also the primary metric. 

Total Sample: 107,783 • Statistical Power at 5% MDE: 12.1%

Test #306 on Backstage.com by Stanley ZuoStanley Zuo Jul 09, 2020 Desktop Mobile Pricing X.X% Sales

Stanley Tested Pattern #69: Autodiscounting On Backstage.com

Pattern #69: Autodiscounting - Variant A
Pattern #69: Autodiscounting - Variant B

In this experiment, the only change was an added message at the top of the pricing screen, clarifying that there is an active discount on a yearly plan. The discount was already communicated with a strike-through price on the control version as well. The variation simply emphasized this aggressively. 

Total Sample: 15,106 • Statistical Power at 5% MDE: 17.8%

Test #299 on Backstage.com by Stanley ZuoStanley Zuo May 22, 2020 Desktop Mobile Listing X.X% Sales

Stanley Tested Pattern #60: Repeated Bottom Call To Action On Backstage.com

Pattern #60: Repeated Bottom Call To Action - Variant A
Pattern #60: Repeated Bottom Call To Action - Variant B

In this experiment, at the bottom of a search results screen, a membership join button was added along with 3 encouraging reasons. The experiment measured membership funnel starts, as well as paid membership transactions (sales).

Total Sample: 106,791 • Statistical Power at 5% MDE: 12.2%

Test #285 on Ibood.com by Lukas JorissenLukas Jorissen Feb 27, 2020 Desktop Product X.X% Sales

Lukas Tested Pattern #7: Social Counts On Ibood.com

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B

In this experiment, realtime social proof information has been added below an add-to-cart button. The variation shows how many users that have viewed, or placed a product into their basket. Translated to "4 visitors have this product in their shopping cart."

Total Sample: 137,190 • Statistical Power at 5% MDE: 36.7%

Test #284 on Thomasnet.com by Julian GaviriaJulian Gaviria Feb 19, 2020 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #78: Tags, Badges And Structured Information On Thomasnet.com

Pattern #78: Tags, Badges And Structured Information - Variant A
Pattern #78: Tags, Badges And Structured Information - Variant B

In this experiment, structured data tags were displayed on a listing page to help potential buyers make better decisions. The additional information about the listed companies included: annual revenue, employee count, and year of establishment.

Total Sample: 241,428 • Statistical Power at 5% MDE: 13%

Test #279 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jan 16, 2020 Desktop Mobile Home & Landing X.X% Sales

Lars Tested Pattern #79: Product Highlights On Umbraco.com

Pattern #79: Product Highlights - Variant A
Pattern #79: Product Highlights - Variant B

In this experiment, 3 additional course links with descriptions were added to the homepage. The idea was to increase course sales aside of the Saas subscription signups.

Total Sample: 22,540 • Statistical Power at 5% MDE: 3.7%

Test #276 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Dec 31, 2019 Desktop Mobile Home & Landing X.X% Signups

Lars Tested Pattern #111: Field Explanations On Umbraco.com

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment, the idea was to move away from copy that was focusing on the needs of the company ("we need your email") towards copy that hinted at a customer benefit ("create your trial").

Total Sample: 48,811 • Statistical Power at 5% MDE: 9.4%

Test #271 on Analytics-toolkit.co... by Georgi Z. GeorgievGeorgi Z. Georgiev Nov 24, 2019 Desktop Mobile Signup X.X% Signups

Georgi Tested Pattern #4: Testimonials On Analytics-toolkit.co...

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, the test variant showed 2 testimonials on the user registration / free trial registration page at Analytics-Toolkit.com

Total Sample: 2,432 • Statistical Power at 5% MDE: 17.4%

Test #267 on Backstage.com by Stanley ZuoStanley Zuo Nov 05, 2019 Mobile Checkout X.X% Sales

Stanley Tested Pattern #99: Progress Bar On Backstage.com

Pattern #99: Progress Bar - Variant A
Pattern #99: Progress Bar - Variant B

A "Step X of 4" progress bar was tested against a fully visible one that was also clickable.

Total Sample: 8,552 • Statistical Power at 5% MDE: 6%

Test #266 by Someone Someone Oct 25, 2019 Desktop Mobile Product X.X% Sales

Someone Tested Pattern #4: Testimonials

Pattern #4: Testimonials - Variant A
Pattern #4: Testimonials - Variant B

In this experiment, a product page showed customer reviews at the bottom of the page (B) instead of hiding them under a tab (A).

Total Sample: 17,139 • Statistical Power at 5% MDE: 15.4%

Test #263 on Goodui.org by Jakub LinowskiJakub Linowski Oct 04, 2019 Desktop Mobile Home & Landing X.X% Signups

Jakub Tested Pattern #22: Empowering Headline On Goodui.org

Pattern #22: Empowering Headline - Variant A
Pattern #22: Empowering Headline - Variant B

In this experiment a different headline was tested. "Reach Higher Conversions Faster" vs. "Learn From What We Try And Test".

Total Sample: 53,636 • Statistical Power at 5% MDE: 24.3%

Test #262 on Thomasnet.com by Julian GaviriaJulian Gaviria Oct 03, 2019 Desktop Mobile Listing X.X% Leads

Julian Tested Pattern #32: Condensed List On Thomasnet.com

Pattern #32: Condensed List - Variant A
Pattern #32: Condensed List - Variant B

In this experiment, the B version condensed the company listings. This was done by showing less of the description and introducing a "more" and "less" dynamic links that would expand and collapse the description.

Total Sample: 105,732 • Statistical Power at 5% MDE: 8.6%

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Sales

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

Pattern #111: Field Explanations - Variant A
Pattern #111: Field Explanations - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #260 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 16, 2019 Desktop Home & Landing X.X% Sales

Online Tested Pattern #45: Benefit Bar On Valkexclusief.nl

Pattern #45: Benefit Bar - Variant A
Pattern #45: Benefit Bar - Variant B

In this experiment on Valk Exclusief's web site, a transparent overview of the benefits for booking hotels was shown. The copy translates to: "Why should you book here? - 5€ Loyalty Discount - Best Price Guarantee - Discount On Packages - No Reservation Costs. Valk is a 150 year hotel chain in the Netherlands.

Test #258 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

Pattern #110: Optional Field Labels - Variant A
Pattern #110: Optional Field Labels - Variant B

In this variation an optional field label was added.

Total Sample: 5,965 • Statistical Power at 5% MDE: 22.6%

Test #259 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

Pattern #110: Optional Field Labels - Variant A
Pattern #110: Optional Field Labels - Variant B
Total Sample: 5,890 • Statistical Power at 5% MDE: 31.9%

Test #249 on Autoscout24.com by Optimizely Optimizely Jul 17, 2019 Desktop Product X.X% Leads

Optimizely Tested Pattern #20: Canned Response On Autoscout24.com

Pattern #20: Canned Response - Variant A
Pattern #20: Canned Response - Variant B

AutoScout24 is Europe’s largest online marketplace for new and used cars. As published by Optimizely, they tested a form pre-filled with text that read: ‘Hello. I am interested in your vehicle. Please contact me. Kind regards.’ 

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

Pattern #88: Action Button - Variant A
Pattern #88: Action Button - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 • Statistical Power at 5% MDE: 47.9%

Test #242 by Alex JamesAlex James May 27, 2019 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #7: Social Counts

Pattern #7: Social Counts - Variant A
Pattern #7: Social Counts - Variant B
Total Sample: 79,012 • Statistical Power at 5% MDE: 56.8%