Hacker News new | ask | show | jobs
by theginger 665 days ago
How do you rate limit unidentified users? If you are treating all unidentified users, or at least all Google bots as 1 user and they consider each Google bot instances with a unique ip and no credentials a unique user and are hitting a 429 with a single request they may be treating that as a 503 instead.
1 comments

Simply identifying them by IP so that each Google bot instance is a unique user ...