Hacker News new | ask | show | jobs
by nbsd4lyfe 3075 days ago
Our git repository went down when crawlers decided to index it
1 comments
dx034 3075 days ago
But probably not Google. The google crawler is very careful and stops as soon as they encounter higher error rates. Bing appears to do the same.
link