Hacker News new | ask | show | jobs
by arblify 2247 days ago
Once you commit to some success metric, you're going to be stuck with it even it proves to be a bad metric. Let's say we all agree the "2 weeks with decreasing number of deaths" is a good target. Then we go back to work, and we discover that going back triggers a rapid spread and kills a bunch of people and starts to overwhelm hospitals. Now we need a new metric.

This is a novel scientific problem. Caution and study are warranted. People's lives are at stake.

1 comments

People's lives are always at stake. That's how public policy works. Like 100% of the time. Try painting lines on the highway or administering a school lunch program without putting people's lives at stake.

The only thing novel here is completely abandoning the concept of public policy goals. There's nothing scientific about setting your public policy without any metrics at all. This is kind of the opposite of a scientific approach.

I'm not suggesting having no metrics, I'm talking about hard targets. Acknowledging that there are things we don't know about the problem and that we're not overcommitting to a course of action based on some specific target is reasonable.

At the same time, to your point, I would like to see clear explanations of "these are the aspects of the disease we are trying to understand (virality, mortality, etc)," these are the constraints on our healthcare system, these are the economic effects, here are the tradeoffs we're trying to make. All of that stuff is good, but it's a complex problem and assuming that we know enough at this point to set a clear numerical goal seems wrong to me. Describing general parameters for our data gathering and decision-making is good, though, and I agree that I'd like to see more of it.

I think that the government agency in charge of the shutdown should be able to answer each of three basic questions with clarity and some kind of numerical response:

1) What are you hoping this policy will accomplish?

2) What sequence of events, if any, would cause you to accelerate your timetable for easing restrictions?

3) What sequence of events, if any, would cause you to delay your timetable for easing restrictions?

I mean those should be the raw basic cost of even having this conversation. I am used to seeing magical thinking and emotional political arguments in many places but I am surprised to see such hostility to a basic quantitative approach on HN of all places.

Your questions are all reasonable. I'm not personally opposed to quantitative decision-making, but I'm also painfully aware of the limitations of quantitative methods, especially when applied under pressure. I would argue that a blind faith in mathematics is just as wrongheaded as the magical thinking you're describing.

To give a clear example of why I'm skeptical, look at the use of quantitative methods to conduct governance in the banking industry. It's not that we shouldn't have used numerical methods, it's just that they ended up being woefully insufficient because of how they were applied. There's no reason we couldn't make the same mistake here in a premature bid for some kind of certainty.

Yeah but this is like setting monetary policy without using interest rates or something. Or coming up with a government spending program and not even trying to do a quick analysis of how much it will cost. It's fucking insane.

Public policy requires metrics and stated goals, and requires that they not be secret. Without those it's not democracy.

We're half-aligned. The decision-making process and the data used to inform it should be public, but I don't think we should be saying at this point "when we see these targets hit we will remove these measures." I think our knowledge is still too incomplete to set that target intelligently.