Hacker News new | ask | show | jobs
by jprusik 4821 days ago
A quick note on missing data - I originally scraped data automatically from the Steam store page when a game wasn't found in the database. But I didn't want to add junk data to the database if the scraped data was bad and still need to figure out how to handle those kinds of exceptions. So for now, the tool makes a note of game IDs that people requested but weren't in the database. That way and I can scrape those separately and review the data before I import it to the database. So even though it doesn't auto-populate, your missing entries will likely be updated in the next database refresh (about once a week, depending on how much time I have available).