Hacker News new | ask | show | jobs
by flavaz 660 days ago
An API for polling data would be cool, one can dream
3 comments

Not so much for polling data, but some governments do allow access to coarse election data.

Australia's was enough that the unfortunately complicated math of their election system was repeatable and verifiable (Can't find the post about it, however)

Good point. However, in my experience messing around with choropleth maps, I often find myself resorting to web scraping in the end when I want something more current (opinion polling). Despite this data being seemingly everywhere, and companies often wanting you to use it (with attribution) so they can get advertising for other services, they never seem to have an API.
Polling is a fool's errand, in my experience, since I'd guess a ton of the "how about now?" responses are "nope"

IMHO sitemap.xml and/or ActivityPub are sleeper approaches to helping the sites with the adversarial relationship they have with scrapers. In my experience, there are two schools of thought: play the very expensive game of cat and mouse (expensive for BOTH sides) of trying to verify the human-ness of visitors, or make it so the inevitable bots don't eat up very expensive and valuable resources that can be spent serving actual humans

Imagine how much less nonsense would have to go on if Amazon had ActivityPub that CamelCamelCamel could subscribe to, or similar for Craigslist

I'm not saying "all information wants to be free," so if Amazon wants to focus its energies on hoarding the review content, since that's arguably its moat, fantastic - let the bot and anti-bot people war over that content, instead of arguably factual data found on the product listing pages

Maybe there is a language issue here. In Australia, a full on election is also called a poll. The government electoral commission does the polling, the voters do the voting.

I think you getting confused with opinion polling.

Ah, that's quite possible - since it was a thread about APIs, I interpreted the question as "a way to programmatically await data arrival" - the verb "polling" in API context is repeatedly invoking a status endpoint to ask if new information is available either in absolute terms or in terms of since the last request

I stand by my rant :-D but obviously stand corrected on the question being asked

What do you mean?
"Polling" as in "voting", not "polling" as in "fetching". Doh!