Hacker News new | ask | show | jobs
by teitoklien 298 days ago
you think they care about that ? they’d still crawl like this just in case which is why they don’t rate limit atm
1 comments

It would of course need to be legally enforced somehow, with penalties high enough to hurt even the big players.