Hacker News new | ask | show | jobs
by Hamuko 318 days ago
It is. They do go further than just ignoring robots.txt too.

https://blog.cloudflare.com/perplexity-is-using-stealth-unde...