Your filter results
Become a member to unlock the abiltiy to see the highest impact a/b tests. Being able to see the actual test results and sort by impact allows growth and experimentation teams to take action on the biggest gains first
Test #324 on
by
Jakub Linowski
Oct 30, 2020
Desktop
Mobile
Product
Jakub Linowski Tested Pattern #17: Least Or Most Expensive First In Test #324


This experiment tested the order of purchase plans. The control version sorted the purchase options by the least expensive while the variation sorted them by the most expensive first. Impact on sales and revenue was measured.
Test #323 on
Backstage.com
by
Stanley Zuo
Oct 29, 2020
Mobile
Signup
Stanley Zuo Tested Pattern #117: Company Logos In Test #323 On Backstage.com


In this experiment, the variation replaced a text testimonial with high-profile production companies that have cast with Backstage. The logos were shown during the signup and checkout flow.
Test #320 on
by
Jakub Linowski
Oct 20, 2020
Desktop
Checkout
Jakub Linowski Tested Pattern #49: Above The Fold Call To Action In Test #320


An extra "Place Order" button was duplicated above the fold on this checkout page. The control had a similar button further down at the bottom of the screen. The impact on total sales was measured from this change.
Test #319 on
Backstage.com
by
Stanley Zuo
Sep 30, 2020
Desktop
Pricing
Stanley Zuo Tested Pattern #113: More Or Fewer Plans In Test #319 On Backstage.com


In this experiment, a 3 plan vs 2 plan pricing page was shown to potential customers. Impact on sales and revenue were measured.
Test #317 on
Volders.com
by
Michal Fiech
Sep 28, 2020
Mobile
Signup
Michal Fiech Tested Pattern #119: Unselected Or Selected Defaults In Test #317 On Volders.com


In this mobile experiment, an unselected vs selected payment plan was tested for its impact on sales. The experiment ran on a mid page of a signup funnel where customers were being asked to select one of two payment plans.
Test #315 on
Backstage.com
by
Stanley Zuo
Aug 22, 2020
Mobile
Signup
Stanley Zuo Tested Pattern #7: Social Counts In Test #315 On Backstage.com


In this experiment, a dynamic number of job postings was displayed during the signup process - reinforcing the value of signing up for membership access.
Test #312 on
by
Jakub Linowski
Aug 14, 2020
Desktop
Mobile
Product
Jakub Linowski Tested Pattern #83: Progressive Fields In Test #312


In this experiment, we tested a visible "Shipping Frequency" (A) option against a progressively displayed one (B) that would only appear after someone first chose a duration option. Thus in variation B, the buy box component would initially appear with fewer fields and smaller. The experiment measured initial progression and actual sales.
Note on the data: the experiment was run a little shorter than usual, as one of the variations triggered a stop rule to protect losses (so the effect might be somewhat inflated from a lower power).
Test #311 on
Backstage.com
by
Stanley Zuo
Aug 11, 2020
Desktop
Mobile
Home & Landing
Stanley Zuo Tested Pattern #118: Category Images In Test #311 On Backstage.com


In this experiment, category links (linking to casting call search results) were replaced with tile images. In addition, 2 levels of categories were also replaced with a single text link for each tile. Finally, the font size of the link titles was also increased.
Test #310 on
Backstage.com
by
Stanley Zuo
Jul 25, 2020
Mobile
Listing
Stanley Zuo Tested Pattern #77: Filled Or Ghost Buttons In Test #310 On Backstage.com


In this experiment, the style of a button leading to view detailed casting calls on a listing page was changed. In version the style was a filled high contrast blue background, and the the B variation there was a feint "ghost button" style.
Test #306 on
Backstage.com
by
Stanley Zuo
Jul 09, 2020
Desktop
Mobile
Pricing
Stanley Zuo Tested Pattern #69: Autodiscounting In Test #306 On Backstage.com


In this experiment, the only change was an added message at the top of the pricing screen, clarifying that there is an active discount on a yearly plan. The discount was already communicated with a strike-through price on the control version as well. The variation simply emphasized this aggressively.
Test #305 on
Volders.de
by
Michal Fiech
Jun 30, 2020
Mobile
Desktop
Home & Landing
Michal Fiech Tested Pattern #94: Visible Search In Test #305 On Volders.de


In this experiment, a search input field (to look for companies) along with most popular links (also company names) were displayed on the homepage of a leading contract cancellation service. The control (A) version instead had a button that sent users to a next page where the same selection could be made - only later. The measurable success criteria were the number of paid cancellations - a few steps down the funnel.
Test #61 on
by
Someone
Jun 26, 2020
Desktop
Checkout
Someone Tested Pattern #9: Multiple Steps In Test #61


In this experiment, a single screen checkout was turned into a series of smaller steps in variation B. This was achieved by showing fewer fields on the first step, and shifting the remaining ones into a 3 step modal popup. The experiment measured successful transactions (sales).
Test #302 on
Volders.de
by
Michal Fiech
Jun 09, 2020
Desktop
Mobile
Signup
Michal Fiech Tested Pattern #83: Progressive Fields In Test #302 On Volders.de


In this experiment a long form (A) was replaced with a progressive form interaction (B). Most of the form fields would appear in a grey-disabled style, until the prerequioste fields were first filled out.
Test #299 on
Backstage.com
by
Stanley Zuo
May 22, 2020
Desktop
Mobile
Listing
Stanley Zuo Tested Pattern #60: Repeated Bottom Call To Action In Test #299 On Backstage.com


In this experiment, at the bottom of a search results screen, a membership join button was added along with 3 encouraging reasons. The experiment measured membership funnel starts, as well as paid membership transactions (sales).
Test #297 on
Trydesignlab.com
by
Daniel Shapiro
May 04, 2020
Desktop
Home & Landing
Daniel Shapiro Tested Pattern #41: Sticky Call To Action In Test #297 On Trydesignlab.com


In this experiment, a sticky "Enroll" button was shown on a course landing page. The button lead to a payment funnel to allow enrolling/paying for a course. The exeperiment measured inital progression into this funnel as well as the deeper completed sales metric.
Test #296 on
Backstage.com
by
Stanley Zuo
Apr 30, 2020
Mobile
Content
Stanley Zuo Tested Pattern #23: Inline Link Nudge In Test #296 On Backstage.com


In this simple experiment, a text link to a join page was injected on an article page. The hypothesis was that more users would signup as a result of this subtle trigger.
Test #293 on
Backstage.com
by
Stanley Zuo
Apr 14, 2020
Desktop
Mobile
Product
Stanley Zuo Tested Pattern #114: Less Or More Visible Prices In Test #293 On Backstage.com


In this experiment on a casting call site, pricing information was shown beside the application button. This change shows the effect of setting a price expectation and being more clear that the application process is not free.
Test #292 on
Backstage.com
by
Stanley Zuo
Apr 13, 2020
Desktop
Mobile
Listing
Stanley Zuo Tested Pattern #24: Visible Availability In Test #292 On Backstage.com


The core hypothesis of this experiment was that by showing clear availability (in green text) beside each casting call, more users would apply and become premium members. The experiment reports on two metrics: application starts (the first progression metric), and premium membership sales (measured a few steps further in the funnel).
Test #290 on
Prepagent.com
by
Arthur Sparks
Mar 23, 2020
Desktop
Pricing
Arthur Sparks Tested Pattern #14: Exposed Menu Options In Test #290 On Prepagent.com


In this experiment, a simple pulldown menu (for US state selection) was replaced with all state options shown as selectable buttons. The states were also abbreviated.
Test #289 on
Prepagent.com
by
Arthur Sparks
Mar 23, 2020
Desktop
Pricing
Arthur Sparks Tested Pattern #17: Least Or Most Expensive First In Test #289 On Prepagent.com


In this experiment, the order of pricing plans was rearranged as to show the most expensive one first.