Hacker News new | ask | show | jobs
by 0_o 4499 days ago
taobao.com has the shortest robots.txt http://www.taobao.com/robots.txt