Hacker News new | ask | show | jobs
by roel_v 4158 days ago
In a roundabout way, that answers the original question, doesn't it? This sort of data is so seldom used, that efforts at 'standardizing' and 'broad distribution' don't scale. You didn't see any value or use in the data for years, only in hindsight, maybe, it would have been fun to look at. Because that's what it is - it's fun (for those from outside the field) to read posts like the OP every once in a while, but there's very little actual value in it, and it's too much work for the vast majority of people to do themselves.

I work in geospatial modelling and I use data like this every day; have been for 15 years. So I know a thing or two about availability of this sort of data, how hard it is to assemble and maintain, and how many people actually do something with it. In the EU, there are directives that create obligations for governments to offer all sorts of data freely to everybody. The amount of money this costs is staggering, and although I'm very happy with it (because it has made my life 100 times easier in the data respect), the useful stuff that is done with it by people who didn't have access to it before is minimal; and certainly disproportional to the amount of money that goes into it. The consultants are laughing all the way to the bank, of course (and hey, I get paid indirectly from it as well, so it's not like I'm complaining).

So that makes the 'data should be open' mantra an entirely ideological disposition. I used to believe it as well, but then why shouldn't we also say 'governments can only spend money on vegan stuff because some people believe in 'animals rights'?' I no longer see pet peeves like 'free data' as black and white as I used to. Bureaucracies are expensive, partly because their goal is not efficiency (which is something that is usually overlooked by the naive) and partly because of other effects inherent to them. We need to restrain ourselves in what and how much we demand from them.