Hacker News new | ask | show | jobs
by zerowisdom 859 days ago
So you don't use a database to store all the data and update it when it needed? Are you allowed to scrape the data?
1 comments

No webpage scraping is involved here, data is from the eBay API. It's not using any database at the moment, just in-memory caching in the Go server. Problem is there are a lot of cache misses which result in API calls of which eBay only allows 5000 a day.

Funnily, the website seems to be crashing due to the API issues while the web server is at <1% CPU utilization.