Hacker News new | ask | show | jobs
by hinkley 580 days ago
Google’s spiders will punish you for giving them too many 429 responses. It’s hell for hosting sites with vanity urls. They can’t tell they’re sending you 50+ req/s.

It’s practically a protection racket. Only AWS gets the money.

1 comments

50 requests/sec? Did you forget a few zeros?
Little’s law is a bitch, and you can get away with a little throttling but not much.

Also, that’s a bit dismissive for HN.