Hacker News new | ask | show | jobs
by cleverjake 4975 days ago
Google ignores robots.txt if the number of inbound links is > N?

Also - any speculation as to how so many sites were lining to peoples login pages?