Hacker News new | ask | show | jobs
by JohnFen 1042 days ago
That's relying on the user agent, though. That's not a trustworthy enough signal for me. For one, crawlers can use any user agent string they like. For another, I don't know what all the possible user agent strings are.