Hacker News new | ask | show | jobs
by wdewind 1553 days ago
How do you handle scraping 1000+ different store websites at scale? Isn't it an enormous amount of work just to maintain the scrapers?
1 comments

Yes it is an enormous amount of work. We do update retailers at different frequencies. The overall inventory gets updated once a week.