Hacker News new | ask | show | jobs
by Flenser 5257 days ago
I'm guessing googlebot creates a lot of initial connections and if this was implemented widely it would speed up crawling.