|
|
|
|
|
by danhardman
3573 days ago
|
|
So you've taken something that only companies with large budgets were able to do, and made it possible for everyone? Any way I can remove my email from your website in case a website I've signed up to hasn't hidden my email sufficiently? What robots.txt rules do I add to protect my users in case emails get posted to my site in comments/posts? |
|
We haven't discussed this yet but it seems like a good idea, so we'll probably have a page dedicated to this where users can tell us to remove their email from our database.
Once we're in beta, our crawler will operate under a specific name which you can refer to in your robots.txt exclusion rules. We'll have an info page for this.