Hacker News new | ask | show | jobs
by webreac 4922 days ago
I hope they have backup of this old content. This robot.txt policy is crap. robot.txt should not be taken into account retroactively when the site owner has changed.