Y
Hacker News
new
|
ask
|
show
|
jobs
by
wdewind
1553 days ago
How do you handle scraping 1000+ different store websites at scale? Isn't it an enormous amount of work just to maintain the scrapers?
1 comments
lgabraham
1553 days ago
Yes it is an enormous amount of work. We do update retailers at different frequencies. The overall inventory gets updated once a week.
link