Hacker News new | ask | show | jobs
by tipiirai 1855 days ago
The secret is on Volument's ability to measure a bunch of "leading indicators", like the ratio of first-time visitors who stayed on the website more than 7 seconds (which indicates a better first impression). For every key conversion event at the bottom of the funnel (such as "signed up"), there are thousands of leading indicators to take insights from. By utilizing these top-of-the-funnel metrics you'll know whether the new version better in a matter of days — even hours on a very busy site.

Another fact is that Volument is a full-blown analytics software it already knows all the data for the baseline variant "A", so you only need to collect data for the "B" variant after a specific timestamp. Further cutting the measurement time by 50%.

More about the topic here:

https://volument.com/learn/

1 comments

That sounds a lot like multiple comparisons type I error as a service.
Can you elaborate this, please? An example would be best.