Hacker News new | ask | show | jobs
by eli 5167 days ago
According to the article, that would not have helped; feedfetcher is meant to be manually triggered and thus does not obey robots.txt
1 comments

For certain definitions of "manually" :)

It's manually triggered to start downloading resources every hour regardless of whether someone needs them.

In that sense, any web spider is "manually triggered" as well ;-)