Hacker News new | ask | show | jobs
by donohoe 802 days ago
And you honor or ignore robots.txt?
1 comments
cpeffer 802 days ago
It wasn't in our initial version (we didn't plan on launching today), but we are pushing an update to do so now.
link