All Latest 642 A/B Tests

MOST RECENT TESTS

Test #236 on by Alex JamesAlex James Apr 04, 2019 Desktop Signup X.X% Signups

Alex Tested Pattern #9: Multiple Steps

- Variant A
- Variant B

In this experiment a single screen signup process was broken into 2 separate steps: account creation & details.
Total Sample: 282,316 • Statistical Power at 5% MDE: 92%

Which A Or B Actually Wins? Find Out Before You Test.

Members see every test result — the winners, the flat ones, and the losers — along with exact effects and sample sizes. Use it to estimate your tests and prioritize by probability, not gut feel. Start every experiment with the odds on your side.

Get Access to All Test Results

Test #233 on Annonce.cz by Ondřej IlinčevOndřej Ilinčev Apr 01, 2019 Desktop Signup X.X% Sales

Ondřej Tested Pattern #100: Postponed Registration On Annonce.cz

- Variant A
- Variant B

In this experiment, the old flow had a login / register / guest checkout as a second step. The variant B flow removed this step and treated everyone as a guest (and later offered to login / register). In the B version guests had a voluntary registration on the thank you page and in a confirmation email. 

 
Total Sample: 12,146 • Statistical Power at 5% MDE: 74%

Test #231 on Glass.net by Mark FreedleMark Freedle Mar 14, 2019 Desktop Mobile Signup X.X% Leads

Mark Tested Pattern #20: Canned Response On Glass.net

- Variant A
- Variant B
Total Sample: 1,342 • Statistical Power at 5% MDE: 6.4%

Test #224 on by Alex JamesAlex James Feb 11, 2019 Desktop Home & Landing X.X% Progression

Alex Tested Pattern #3: Fewer Form Fields

- Variant A
- Variant B

This experiment reduced the search form by removing the distance field.
Total Sample: 97,074 • Statistical Power at 5% MDE: 99.9%

Test #49 on Menufy.com by Aleksandr ElesevAleksandr Elesev Oct 26, 2018 Desktop Mobile Checkout X.X% Sales

Aleksandr Tested Pattern #46: Pay Later On Menufy.com

- Variant A
- Variant B
Total Sample: 21,184 • Statistical Power at 5% MDE: 99.9%

Test #9 on by Rick DawsonRick Dawson Sep 28, 2018 Desktop Mobile Home & Landing X.X% Leads

Rick Tested Pattern #83: Progressive Fields

- Variant A
- Variant B
Total Sample: 27,947 • Statistical Power at 5% MDE: 18.5%

Test #165 on Bomgar.com by Lee ElkinsLee Elkins Apr 04, 2018 Desktop Signup X.X% Signups

Lee Tested Pattern #64: Tunnel On Bomgar.com

- Variant A
- Variant B
- Variant A
- Variant B
Total Sample: 7,191 • Statistical Power at 5% MDE: 11.8%

Test #155 on Mt.com by Vito MediavillaVito Mediavilla Feb 22, 2018 Mobile Product X.X% Leads

Vito Tested Pattern #3: Fewer Form Fields On Mt.com

- Variant A
- Variant B
Total Sample: 8,652 • Statistical Power at 5% MDE: 5.3%

Test #146 on Goodui.org by Jakub LinowskiJakub Linowski Jan 25, 2018 Desktop Mobile Home & Landing X.X% Leads

Jakub Tested Pattern #49: Above The Fold Call To Action On Goodui.org

- Variant A
- Variant B
Total Sample: 1,090 • Statistical Power at 5% MDE: 3.3%

Test #147 on Reverb.com by Nicholas EvansNicholas Evans Jan 25, 2018 Desktop Mobile Product X.X% Sales

Nicholas Tested Pattern #20: Canned Response On Reverb.com

- Variant A
- Variant B
Total Sample: 40,229 • Statistical Power at 5% MDE: 67.2%

Test #145 on Normanrecords.com by Nathon RaineNathon Raine Jan 18, 2018 Desktop Checkout X.X% Sales

Nathon Tested Pattern #1: Remove Coupon Fields On Normanrecords.com

- Variant A
- Variant B

In this test the coupon field was replaced with a small link that would bring the field back if needed. This is a more suble approach than just completely removing the coupon field. It still allows for the use of coupon fields by those customers which are truly searching for a way to enter their aquired codes.
Total Sample: 4,139 • Statistical Power at 5% MDE: 73.7%

Test #128 on Acousticalsurfaces.c... by Nina BayattiNina Bayatti Dec 02, 2017 Desktop Signup X.X% Leads

Nina Tested Pattern #20: Canned Response On Acousticalsurfaces.c...

- Variant A
- Variant B
Total Sample: 2,951 • Statistical Power at 5% MDE: 7.1%

Test #125 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Nov 13, 2017 Desktop Product X.X% Leads

Rodrigo Tested Pattern #38: Faded Background Form On Vivareal.com.br

- Variant A
- Variant B
Total Sample: 2,628,666 • Statistical Power at 5% MDE: 99.9%

Test #116 on Homewarrantyreviews.... by Sumantha ShankaranarayanaSumantha Shankaranarayana Oct 01, 2017 Desktop Home & Landing X.X% Leads

Sumantha Tested Pattern #33: Example Situations On Homewarrantyreviews....

- Variant A
- Variant B
Total Sample: 5,581 • Statistical Power at 5% MDE: 8.2%

Test #113 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Sep 01, 2017 Desktop Listing X.X% Leads

Rodrigo Tested Pattern #31: Instant Filter Results On Vivareal.com.br

- Variant A
- Variant B
Total Sample: 238,851 • Statistical Power at 5% MDE: 99.7%

Test #100 on Vivareal.com.br by Rodrigo MauésRodrigo Maués Aug 01, 2017 Mobile Product X.X% Leads

Rodrigo Tested Pattern #20: Canned Response On Vivareal.com.br

- Variant A
- Variant B
Total Sample: 203,704 • Statistical Power at 5% MDE: 52.6%

Test #112 on Glass.net by Mark FreedleMark Freedle Jul 14, 2017 Desktop Mobile Signup X.X% Leads

Mark Tested Pattern #20: Canned Response On Glass.net

- Variant A
- Variant B
Total Sample: 13,197 • Statistical Power at 5% MDE: 21.2%

Test #110 on Trydesignlab.com by Daniel ShapiroDaniel Shapiro Jul 01, 2017 Desktop Home & Landing X.X% Signups

Daniel Tested Pattern #14: Exposed Menu Options On Trydesignlab.com

- Variant A
- Variant B
Total Sample: 21,129 • Statistical Power at 5% MDE: 18.2%

Test #109 on 3dhubs.com by Rob DraaijerRob Draaijer Jun 01, 2017 Desktop Signup X.X% Leads

Rob Tested Pattern #20: Canned Response On 3dhubs.com

- Variant A
- Variant B
Total Sample: 4,005 • Statistical Power at 5% MDE: 59.9%

Test #103 on Rollbar.com by Mike SmithMike Smith May 01, 2017 Desktop Home & Landing X.X% Signups

Mike Tested Pattern #11: Gradual Reassurance On Rollbar.com

- Variant A
- Variant B
Total Sample: 20,877 • Statistical Power at 5% MDE: 11.4%