Y
Hacker News
new
|
ask
|
show
|
jobs
by
Flenser
5257 days ago
I'm guessing googlebot creates a lot of initial connections and if this was implemented widely it would speed up crawling.