Hacker News new | ask | show | jobs
by isiahl 1582 days ago
But I could change my clients User Agent to match the Google Crawler?
2 comments
dreamcompiler 1582 days ago
Nope. Because your IP address is not one of Google's. This trick worked years ago but not today.
link
donkarma 1582 days ago
use a GCP instance
link
eminence32 1582 days ago
I'm pretty sure that CGP instances don't allocate IP addresses from the same range as google crawlers.

See also: https://developers.google.com/search/docs/advanced/crawling/...

link
lmm 1582 days ago
Sure, and then you've got a cat-and-mouse game with all the other ways that sites can fingerprint you.
link