Hacker News new | ask | show | jobs
by moneywoes 811 days ago
how do you index reddit cost effectively without breaking their tos
1 comments

We're working with dumps of Reddit data, which means we don't have to use their API or do any scraping on Reddit itself for now. The data is updated monthly though, so we'll have figure out how to get higher quality data for things that are more time sensitive. We're in contact with the folks at Reddit, so we'll try to see if there are ways to get better data later on.