Hacker News new | ask | show | jobs
by skj 4117 days ago
Now you're suggesting that Google basically devotes a team to detecting "crawler-free-quota abuse", when the real solution needs to handles crawlers from many different sources that aren't all Google.