Hacker News new | ask | show | jobs
by manquer 336 days ago
I am curious why these workarounds continue to work .

If the content owners care so much about the paywall integrity they can verify if it is really google bot . Google provides a reverse dns lookup of the IP addresses of their bots[1]

[1] https://developers.google.com/search/docs/crawling-indexing/...