[TeMPOraL]

robots.txt is a gentlemen's agreement between a site and search engine running automated crawlers. It has no meaning for regular visitors.