Hacker News new | ask | show | jobs
by fareesh 766 days ago
is it viable to build a product on top of scraping?

seems like unpredictably any day you could find yourself out of sync or with no data because of infrequent crawls or dom changes or bot challenges and then you have to play cat and mouse

1 comments

There's entire industries built on top of scraping, something changes, you adapt. In this case where the data is actually used to drive more traffic to the cinemas there will be little protection. Very different to Linkedin protecting their user submitted data as that's their value.