Hacker News new | ask | show | jobs
by bryanrasmussen 147 days ago
sorry I don't normally go around poking holes in people's hopeful business plans, but I have thought about the problem of keeping sites from being scraped before, and there are really two issues that everybody needs to work that go against a decent anti-scraping tool and that is

automated testing requirements make it difficult to keep things from scraped, because scraping is an automation process, and automated testing is obviously and automation process.

and the needs for accessibility. Which even if you didn't care about the moral requirements of being accessible the legal requirements force you to be.

And I have also given some thoughts to automated generation of images for a sort of graphing application so I am familiar with the performance issues as well, so your question of course hit all the points that I knew something about.