Revenue Quotes Any Other Conversions
No. We know that you have other important projects to build out and improve and we'll work around those, independently. Once you inject our JavaScript tracking snippet into the target pages, we can lead 95% of most projects. There might be times we reach out to your dev teams for more complex back-end support.
On the performance agreement, how do we ensure that we only pay for what you do?With relative effects. We measure performance in relative terms. So, if you have a good or bad month, it doesn’t matter since those fluctuations are equally distributed within the experiments. We charge by relative effect of B over A.
Will the results of the test be reliable?Yes. We justify all our design decisions and base them on hypotheses. We make sure to run all tests with a proper sample size and a healthy duration. We'll look at things such as: statistical significance, margin of error, week-to-week consistency, and secondary metrics to arrive at an overall assessment.
Who do we typically work with?Online businesses with traction. We work with established online businesses and startups that have monthly visitors of 20,000 or more. This usually provides us with enough traffic to setup the tests. However, it depends on many things (the metric, its baseline, page scope, and effect sensitivity) so talk to us.
How long do we run a test for?It depends.The bare minimum is 1-2 weeks for higher traffic sites. The longest we'll run a test for is about 2-3 months for lower traffic sites. In order to reach greater statistical validity, we'll come up with a testing strategy that accounts for your existing traffic and existing conversion rate.
What results can you expect?We're confident. Each test is different, however looking at past projects we have achieved a median 24% relative improvement for others. That's why we offer performance based agreements.
What if no positive results are found?We share the risk. On a performance based agreement, when no significant and positive results are reached, you do not pay anything as we share the risk and usually try again. On a fixed price Best Shot test, we offer 1 Retest Guarantee for free.
Can you also come up with a complete testing strategy?Yes.We do offer to run smaller projects composed of a few a/b tests, and we also offer more complex sequential testing programs for long term clients.
Do you implement winning tests?Sometimes, at extra cost. After completing or before starting a test, we may offer to perform custom implementation work. This includes adjusting obvious fixes or refining the quality of any tested variations. We offer this at $160 USD per hour.