All Latest 608 A/B Tests

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #311 on Backstage.com by Stanley ZuoStanley Zuo Aug 11, 2020 Desktop Mobile Home & Landing

Stanley Tested Pattern #118: Category Images On Backstage.com

 - Variant A
 - Variant B

In this experiment, category links (linking to casting call search results) were replaced with tile images. In addition, 2 levels of categories were also replaced with a single text link for each tile. Finally, the font size of the link titles was also increased.

Test #309 on Thomasnet.com by Julian GaviriaJulian Gaviria Jul 24, 2020 Desktop Listing

Julian Tested Pattern #72: Priming Step On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, an extra step was prepended at the beginning of a multiple step signup modal flow. The signup modal would appear on listing pages after requests to contact a listed company. The idea was to prime users with benefits of signing up in order to increase their motivation to do so. The experiment measured the impact on the initial progression (to the step with the email form).

Test #308 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Jul 23, 2020 Desktop Home & Landing

Lars Tested Pattern #4: Testimonials On Umbraco.com

 - Variant A
 - Variant B

In this experiment, three testimonials were added mid way though on a CMS landing page. At the end of the customer testimonials an additional trial signup button was also added - which was also the primary metric. 

Test #307 on Volders.de by Michal FiechMichal Fiech Jul 17, 2020 Desktop Thank You

Michal Tested Pattern #77: Filled Or Ghost Buttons On Volders.de

 - Variant A
 - Variant B

This experiment measured a shallow click goal on a button that would encourage to repeated the action that was just completed (in this case a contract cancellation). In the control version (A) a thank-you screen shows a filled button style, and the variant (B) there was a ghost button. As a note, I also flipped the A-B in this experiment for the purpose of matching it to our ghost button pattern, which means that Volders in fact was starting  out with a ghost button to begin with. 

Test #306 on Backstage.com by Stanley ZuoStanley Zuo Jul 09, 2020 Desktop Mobile Pricing

Stanley Tested Pattern #69: Autodiscounting On Backstage.com

 - Variant A
 - Variant B

In this experiment, the only change was an added message at the top of the pricing screen, clarifying that there is an active discount on a yearly plan. The discount was already communicated with a strike-through price on the control version as well. The variation simply emphasized this aggressively. 

Test #305 on Volders.de by Michal FiechMichal Fiech Jun 30, 2020 Mobile Desktop Home & Landing

Michal Tested Pattern #94: Visible Search On Volders.de

 - Variant A
 - Variant B

In this experiment, a search input field (to look for companies) along with most popular links (also company names) were displayed on the homepage of a leading contract cancellation service. The control (A) version instead had a button that sent users to a next page where the same selection could be made - only later. The measurable success criteria were the number of paid cancellations - a few steps down the funnel.

Test #303 on Thomasnet.com by Julian GaviriaJulian Gaviria Jun 26, 2020 Desktop Mobile Global

Julian Tested Pattern #14: Exposed Menu Options On Thomasnet.com

 - Variant A
 - Variant B

In this experiment variation, the saved suppliers feature was surfaced in the global navigation.It was already possible to save supplier companies from listing and specific company pages. This experiment aimed to increase the saving functions visibility and possibly increase more leads. 

Test #61 on by Someone Someone Jun 26, 2020 Desktop Checkout

Someone Tested Pattern #9: Multiple Steps

 - Variant A
 - Variant B

In this experiment, a single screen checkout was turned into a series of smaller steps in variation B. This was achieved by showing fewer fields on the first step, and shifting the remaining ones into a 3 step modal popup. The experiment measured successful transactions (sales).

Test #302 on Volders.de by Michal FiechMichal Fiech Jun 09, 2020 Desktop Mobile Signup

Michal Tested Pattern #83: Progressive Fields On Volders.de

 - Variant A
 - Variant B

In this experiment a long form (A) was replaced with a progressive form interaction (B). Most of the form fields would appear in a grey-disabled style, until the prerequioste fields were first filled out.

Test #301 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto May 31, 2020 Desktop Mobile Product

Vinicius Tested Pattern #21: What It's Worth On Zapimoveis.com.br

 - Variant A
 - Variant B

In this experiment, the B variation property prices were framed using higher and crossed out price points from 12 months ago - achieving a relative discount. A tooltip was also shown which explained the higher price point on hover. The example in the screenshot translates to "2% less compared to 12 months ago". This high-power experiment measured the number of leads that were generated on property (product) screens.

Test #300 on Volders.de by Michal FiechMichal Fiech May 25, 2020 Desktop Mobile Signup

Michal Tested Pattern #3: Fewer Form Fields On Volders.de

 - Variant A
 - Variant B

In this experiment, a password field was removed on a contract cancellation form (Volders).

In the control version, users were required to enter their email address and a password. If the email address was associated with an existing account, then the password was used to authenticate the user (and validated). When users entered a new email address, then the password field was used to create a new account. 

In the variation, the password field was removed, as the authentication happened after the conversion itself using other backend mechanisms.

 

Test #299 on Backstage.com by Stanley ZuoStanley Zuo May 22, 2020 Desktop Mobile Listing

Stanley Tested Pattern #60: Repeated Bottom Call To Action On Backstage.com

 - Variant A
 - Variant B

In this experiment, at the bottom of a search results screen, a membership join button was added along with 3 encouraging reasons. The experiment measured membership funnel starts, as well as paid membership transactions (sales).

Test #298 on Zapimoveis.com.br by Vinicius Barros PeixotoVinicius Barros Peixoto May 14, 2020 Desktop Mobile Listing

Vinicius Tested Pattern #36: Fewer Or More Results On Zapimoveis.com.br

 - Variant A
 - Variant B

In this experiment on a listing page, the search was expanded to show more listings (variation B). Conditionally, if there were fewer than 36 results, set basic filters such as number bedrooms and bathrooms were expanded and appended to the results. Hence if someone chose 2 bedrooms and 2 bathrooms in variation A, they would only see listing with that filter. In variation B however they would first see the filtered results, and later they would also see results with 3 or more of each. 

Test #297 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro May 04, 2020 Desktop Home & Landing

Daniel Tested Pattern #41: Sticky Call To Action On Trydesignlab.com

 - Variant A
 - Variant B

In this experiment, a sticky "Enroll" button was shown on a course landing page. The button lead to a payment funnel to allow enrolling/paying for a course. The exeperiment measured inital progression into this funnel as well as the deeper completed sales metric.

Test #295 on Thomasnet.com by Julian GaviriaJulian Gaviria Apr 29, 2020 Desktop Mobile Content

Julian Tested Pattern #25: Nagging Results On Thomasnet.com

 - Variant A
 - Variant B

In this experiment, blog article pages were hidden behind a registration wall - requing a signup to access. The registration wall would appear after the first paragraph using gradual opacity to cover the rest of the article. We have published the effects of this change on registrations (signups) and on engagement (users viewing other more important company detail pages).

Test #294 on Umbraco.com by Lars Skjold IversenLars Skjold Iversen Apr 23, 2020 Desktop Pricing

Lars Tested Pattern #115: Pricing Comparison Table On Umbraco.com

 - Variant A
 - Variant B

In this experiment, plan properties on a pricing page were horizontally aligned (for easier comparison). More so, labels and values were also broken on separate lines.

Test #293 on Backstage.com by Stanley ZuoStanley Zuo Apr 14, 2020 Desktop Mobile Product

Stanley Tested Pattern #114: Less Or More Visible Prices On Backstage.com

 - Variant A
 - Variant B

In this experiment on a casting call site, pricing information was shown beside the application button. This change shows the effect of setting a price expectation and being more clear that the application process is not free.

Test #292 on Backstage.com by Stanley ZuoStanley Zuo Apr 13, 2020 Desktop Mobile Listing

Stanley Tested Pattern #24: Visible Availability On Backstage.com

 - Variant A
 - Variant B

The core hypothesis of this experiment was that by showing clear availability (in green text) beside each casting call, more users would apply and become premium members. The experiment reports on two metrics: application starts (the first progression metric), and premium membership sales (measured a few steps further in the funnel).

Test #289 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing

Arthur Tested Pattern #17: Least Or Most Expensive First On Prepagent.com

 - Variant A
 - Variant B

In this experiment, the order of pricing plans was rearranged as to show the most expensive one first.

Test #290 on Prepagent.com by Arthur SparksArthur Sparks Mar 23, 2020 Desktop Pricing

Arthur Tested Pattern #14: Exposed Menu Options On Prepagent.com

 - Variant A
 - Variant B

In this experiment, a simple pulldown menu (for US state selection) was replaced with all state options shown as selectable buttons. The states were also abbreviated.