Hacker News new | ask | show | jobs
by mdaniel 1045 days ago
If they were going to the amount of energy to do a 2nd crawl using a different user agent, then why bother advertising the user agent at all and just feed it the Chrome one like every other home-grown spider does