All Latest 615 A/B Tests

Screen

Device

Metric

Tag

Power of 80%+ for

Only Significant

p-value < 0.05

Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first

MOST RECENT TESTS

Test #242 on by Alex James May 27, 2019 Desktop Mobile Signup

Alex Tested Pattern #7: Social Counts

Test #241 on Kenhub.com by Niels Hapke May 24, 2019 Desktop Mobile Signup

Niels Tested Pattern #105: Lead Magnets On Kenhub.com

In this experiment, a free study guide ebook was promoted on a registration page.

Test #240 on Thomasnet.com by Julian Gaviria May 16, 2019 Desktop Listing

Julian Tested Pattern #13: Centered Forms & Buttons On Thomasnet.com

In this experiment, two different positions of the View Catalog button were compared. In version A the button was smaller and on the right. In version B the button was wider and more central. (The actual test was inverted before publishing to match the A-B of the pattern.)

Test #236 on by Alex James Apr 04, 2019 Desktop Signup

Alex Tested Pattern #9: Multiple Steps

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.

Test #235 on Thomasnet.com by Julian Gaviria Apr 02, 2019 Desktop Mobile Home & Landing

Julian Tested Pattern #102: Expanded Or Condensed Layout On Thomasnet.com

In this experiment, the layout was condensed from a taller to a shorter one.

Test #233 on Annonce.cz by Ondřej Ilinčev Apr 01, 2019 Desktop Signup

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email.

Test #234 on by Alex James Apr 01, 2019 Desktop Listing

Alex Tested Pattern #101: Search Keyword Highlighting

In this experiment, a different style for keyword highlighting was used.

Test #232 on Yoast.com by Sjardo Janssen Mar 15, 2019 Desktop Mobile Checkout

Sjardo Tested Pattern #6: Customer Star Ratings On Yoast.com

In this experiment, the Yoast team replaced one of the bulleted reassurances on their checkout page ("4.9 out of 5 stars" vs "24/7 Free support"). Raising the question - is free support or high reviews valued more? - Thanks Sjardo & Meike for sharing!

Test #230 on Goodui.org by Jakub Linowski Mar 09, 2019 Desktop Mobile Listing

Jakub Tested Pattern #56: Hover Button On Goodui.org

In this test we tested onhover buttons (variant) versus more traditional always exposed and visible ones.

Test #227 on Volders.de by Alexander Krieger Mar 04, 2019 Desktop Signup

Alexander Tested Pattern #99: Progress Bar On Volders.de

In this experiment, a simple progress bar was added to a 2nd step of contract cancellation funnel. The progress bar used separate styles to show which steps were completed, what the current step was, as well as the future step.

Translation of the 3 steps from German are as follows:

Fill out the termination
Send termination
Proof of termination

Test #225 on by Devesh Khanal Feb 17, 2019 Desktop Product

Devesh Tested Pattern #41: Sticky Call To Action

Test #224 on by Alex James Feb 11, 2019 Desktop Home & Landing

Alex Tested Pattern #3: Fewer Form Fields

This experiment reduced the search form by removing the distance field.

Test #222 on Thomasnet.com by Julian Gaviria Feb 01, 2019 Desktop Listing

Julian Tested Pattern #7: Social Counts On Thomasnet.com

In this variation, a number of social proof references were added to a signup modal.

Test #220 on by Alex James Jan 18, 2019 Desktop Listing

Alex Tested Pattern #34: Open In A New Tab

This experiment measured the effect of opening new listing (job applications) in a new tab, against opening them in the same window. The experiment A-B was inversed to match the pattern (in reality, the original already opened the tabs in a new window).

Test #215 on Vivareal.com.br by Vinicius Barros Peixoto Dec 21, 2018 Mobile Listing

Vinicius Tested Pattern #92: Already Viewed Label On Vivareal.com.br

The idea of this test was to add a "Viewed" label on a listing page to indicate listings which have already been viewed by users.

Test #209 on Vivareal.com.br by Vinicius Barros Peixoto Nov 12, 2018 Mobile Listing

Vinicius Tested Pattern #34: Open In A New Tab On Vivareal.com.br

The idea of this experiment was taking advantage of mobile browser behavior. When a link is open in a new tab on mobile browsers, and users hit the back button, the tab closes and users get back exactly where they were before without any new result page load.

Test #206 on Yummly.com by Kimberly Cheung Oct 25, 2018 Desktop Mobile Signup