Hacker News new | ask | show | jobs
by nostromo 2171 days ago
2020 is very atypical and not a good time to run a "marketing off" test.

Even if you did an A/B or multivariate test across different markets, you'd probably be measuring local responses to Covid more than you'd be measuring Facebook marketing effectiveness.

3 comments

On the other hand, with stay-at-home orders media consumption is at an all-time high. Ads should outperform in this environment.
Engagement rates are way up, but conversion rates are down. Overall a net benefit in my line of business, but it's affecting other segments different ways.
This assumes your conversion rate from media is the same. It's reasonable to hypothesize that most are significantly more reluctant to spend money in this environment.
Agreed; it depends on the product.
With that same argument you can conclude that since 2020 is very atypical then it's not a good time to run the usual strategy of last year. Might as well switch it up, cut costs or react (in case they saw that ad clicks went up, but not the actual sales).
It doesn't matter. The test is "should we be spending money on this in 2020", not testing a hypothetical situation where the pandemic doesn't exist.