Y
Hacker News
new
|
ask
|
show
|
jobs
by
simonw
358 days ago
Oh wow, I missed that! That's from the docs for that Perplexity‑User user-agent, at which point presumably there's no point in listing that in robots.txt at all?