All Latest 633 A/B Tests

MOST RECENT TESTS

Test #105 on Inktweb.nl by Martijn OudMartijn Oud Sep 23, 2019 Desktop Mobile Signup X.X% Signups

Martijn Tested Pattern #111: Field Explanations On Inktweb.nl

 - Variant A
 - Variant B

In this experiment, onhover tooltip explanations were added to selected fields (Firstname, Lastname, Phone, Email and Password). One translation example of the Firstname tooltip was the following "Enter your first name (or letter) so that we can address you in a more personal way".

Total Sample: 3,169 Statistical Power at 5% MDE: 27.7%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Test #261 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 20, 2019 Desktop Checkout X.X% Sales

Online Tested Pattern #111: Field Explanations On Valkexclusief.nl

 - Variant A
 - Variant B

In this experiment on Valk Exclusief's web site, a reason was provided for why the e-mail address is being collected. Google translation of the added text is as follows: "If your e-mail address is not yet known to us, we will ask you to add some missing information. Then you immediately benefit from our benefits such as the ValkLoyal savings program."

Test #260 on Valkexclusief.nl by Online DialogueOnline Dialogue Sep 16, 2019 Desktop Home & Landing X.X% Sales

Online Tested Pattern #45: Benefit Bar On Valkexclusief.nl

 - Variant A
 - Variant B

In this experiment on Valk Exclusief's web site, a transparent overview of the benefits for booking hotels was shown. The copy translates to: "Why should you book here? - 5€ Loyalty Discount - Best Price Guarantee - Discount On Packages - No Reservation Costs. Valk is a 150 year hotel chain in the Netherlands.

Test #258 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this variation an optional field label was added.

Total Sample: 5,965 Statistical Power at 5% MDE: 22.6%

Test #259 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 12, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #110: Optional Field Labels On Thomasnet.com

 - Variant A
 - Variant B
Total Sample: 5,890 Statistical Power at 5% MDE: 31.9%

Test #257 on Thomasnet.com by Julian GaviriaJulian Gaviria Sep 09, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #109: Required Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this followup experiment, field labels without and with a marked asterisk were tested.

Total Sample: 5,739 Statistical Power at 5% MDE: 31.3%

Test #256 on by Alex JamesAlex James Aug 23, 2019 Desktop Mobile Signup X.X% Signups

Alex Tested Pattern #109: Required Field Labels

 - Variant A
 - Variant B

The original had no fields marked as required. The variant had all fields marked as required with an asterisk (and a reference note).

Total Sample: 116,470 Statistical Power at 5% MDE: 75.4%

Test #255 on Thomasnet.com by Julian GaviriaJulian Gaviria Aug 22, 2019 Desktop Mobile Signup X.X% Signups

Julian Tested Pattern #109: Required Field Labels On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, field labels without and with a marked asterisk were tested.

Total Sample: 5,977 Statistical Power at 5% MDE: 22.6%

Test #254 on Volders.de by Alexander KriegerAlexander Krieger Aug 16, 2019 Desktop Mobile Signup X.X% Revenue

Alexander Tested Pattern #17: Least Or Most Expensive First On Volders.de

 - Variant A
 - Variant B

In this experiment, 4 things were adjusted in the variation: the highest pricing plan was shifted to the left, it was set as the default one, the recommendation was also adjusted to point to the highest plan, and one benefit from the lowest plan was removed (customer support).

Test #40 on Adoramapix.com by Herman KleinHerman Klein Aug 13, 2019 Desktop Product X.X% Sales

Herman Tested Pattern #85: Benefit Button On Adoramapix.com

 - Variant A
 - Variant B

In this experiment only the button label changed. The control had a more immediate (next step-oriented) button label of "Upload Your Photos Now". The variation tried a more benefit-oriented button of "Order Now" (hinting at paying and obtaining the product).

Total Sample: 13,454 Statistical Power at 5% MDE: 43.7%

Test #253 on Volders.de by Alexander KriegerAlexander Krieger Aug 08, 2019 Desktop Mobile Signup X.X% Revenue

Alexander Tested Pattern #17: Least Or Most Expensive First On Volders.de

 - Variant A
 - Variant B

In this experiment, two pricing plans were inverted to show the most expensive plan first (in the variation).

Test #252 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 30, 2019 Desktop Mobile Content X.X% Engagement

Julian Tested Pattern #107: Contrast Links & Buttons On Thomasnet.com

 - Variant A
 - Variant B

In this experiment a light blue bold link was tested against a darker blue bold link. 

Total Sample: 142,102 Statistical Power at 5% MDE: 74.3%

Test #250 on Volders.de by Alexander KriegerAlexander Krieger Jul 25, 2019 Desktop Mobile Signup X.X% Signups

Alexander Tested Pattern #106: Back Buttons On Volders.de

 - Variant A
 - Variant B

In this experiment, a version without a back button was tested against a one where it was positioned in the upper left corner. This test occured on a second step of a contract cancellation service.

Total Sample: 16,894 Statistical Power at 5% MDE: 81%

Test #251 on Goodui.org by Jakub LinowskiJakub Linowski Jul 25, 2019 Desktop Mobile Content X.X% Signups

Jakub Tested Pattern #57: Maybe Later On Goodui.org

 - Variant A
 - Variant B

In this experiment, we tested a standard modal (with 2 choices) against a "Maybe Later" one (with 3 choices). One of the choices in the variant allowed users to postpone their decision with a "maybe" which would enable a floating bar at the bottom of the screen. Clicking on any of the "Yes" options would send people to the bottom of the screen with an email signup form. Increasing signup was our primary measure. Both modals also appeared instantly after a page load.

Total Sample: 7,759 Statistical Power at 5% MDE: 7.2%

Test #249 on Autoscout24.com by Optimizely Optimizely Jul 17, 2019 Desktop Product X.X% Leads

Optimizely Tested Pattern #20: Canned Response On Autoscout24.com

 - Variant A
 - Variant B

AutoScout24 is Europe’s largest online marketplace for new and used cars. As published by Optimizely, they tested a form pre-filled with text that read: ‘Hello. I am interested in your vehicle. Please contact me. Kind regards.’ 

Test #248 on Volders.de by Alexander KriegerAlexander Krieger Jul 16, 2019 Desktop Signup X.X% Sales

Alexander Tested Pattern #20: Canned Response On Volders.de

 - Variant A
 - Variant B

In this experiment, an editable contract cancellation letter was tested against a non-editable one. The editable letter first appeared in a text state, which required a click on a link in order for it to be transformed into an editable textarea field.

Total Sample: 13,878 Statistical Power at 5% MDE: 20.5%

Test #39 on Over-blog.com by Tael PinaultTael Pinault Jul 02, 2019 Desktop Signup X.X% Signups

Tael Tested Pattern #83: Progressive Fields On Over-blog.com

 - Variant A
 - Variant B

This test explored a progressive disclosure interaction in variation B. When a user started typing text into the first field, two more fields expanded into view.

Total Sample: 10,464 Statistical Power at 5% MDE: 37.8%

Test #247 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 13, 2019 Desktop Mobile Content X.X% Signups

Julian Tested Pattern #41: Sticky Call To Action On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the same message (with a link) for signing up to a newsletter was shown in two distinct ways. The control (A) showed the signup message as inline one that preceded the content of the article at the very top. The variant showed the same signup message as a scroll-delayed sticky interaction at the bottom of the screen. The background color of the B variant was also inverted to match the style of the footer.

Total Sample: 76,900 Statistical Power at 5% MDE: 4.6%

Test #246 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 12, 2019 Desktop Mobile Home & Landing X.X% Progression

Julian Tested Pattern #88: Action Button On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, the navigation label was changed from "Network" to "Find Suppliers". The idea was to make use of an action label with a clearer benefit.

Total Sample: 956,112 Statistical Power at 5% MDE: 47.9%

Test #245 on Kenhub.com by Niels HapkeNiels Hapke Jun 11, 2019 Desktop Signup X.X% Signups

Niels Tested Pattern #19: Benefit Testimonials On Kenhub.com

 - Variant A
 - Variant B

In this experiment a more elaborate and authentic testimonial was used instead of three more generic ones from social media sites.

Total Sample: 130,872 Statistical Power at 5% MDE: 99.7%