Hacker News new | ask | show | jobs
by utopcell 1231 days ago
GitHub would not be happy with Google cloning all repos, and many of them at a high frequency, in order to circumvent a robots.txt restriction.
1 comments

They're clever people, they could just do partial updates (pull instead of clone). I doubt it'd be that much of a strain.