Hacker News new | ask | show | jobs
by simonw 358 days ago
Oh wow, I missed that! That's from the docs for that Perplexity‑User user-agent, at which point presumably there's no point in listing that in robots.txt at all?