Hacker News new | ask | show | jobs
by jsheard 637 days ago
Pretty sure that won't work, they let you validate whether an IP address is used by GoogleBot specifically, not just owned by Google in general. I doubt they are foolish enough to use the same pool of IP addresses for their internal crawlers and their public cloud.

https://developers.google.com/search/docs/crawling-indexing/...

1 comments

It depends how the site has implemented it, a huge number just look for AS origination and *googleuserconent.com