Hacker News new | ask | show | jobs
by huytersd 886 days ago
Are you suggesting the government put their public access API behind a paywall?
1 comments
tonymet 886 days ago
This data domain doesn’t need a realtime api. They could host CSVs online with some mirrors and save millions of dollars hosting this stuff.
link
huytersd 885 days ago
Ah yes, I see now. Yeah makes no sense to offer a REST response for each request.

On that note, what would the processing entail? Processing the get request and packaging the entire dataset into a REST object right? Or is it a more complex API that lets you run queries against the dataset? For that matter wouldn’t downloading a CSV also have to be packaged into a REST object?

link
tonymet 885 days ago
the rest API provides parameters for filtering & pagination. all of that is unnecessary. it's a few hundred MB tops . CSV , Bigquery , anything is better than running REST on EC2
link