Hacker News new | ask | show | jobs
by triplewipeass 2651 days ago
You could put up a robots.txt denying all search engines.
1 comments
natch 2651 days ago
But the issue is not just what he could do, but what malicious content generation systems could do.
link
triplewipeass 2651 days ago
The issue is, as stated:

> I am actually a bit worried that I’m already starting to see search engine traffic coming in...

We can discuss hypothetical systems that could maliciously flood us with generated content. The creator of this particular service which is being discussed here and now could also begin taking steps to ensure that his creation does not inadvertently create a problem for some hapless Google user.

link
natch 2651 days ago
Well, no. You have to read further up the thread to see the issue I was referring to.

>I wonder if our current discussion boards on the interwebs can survive the coming influx of content like this and the next generations of it that follow.

Yes the robots.txt is a good and trivial step he could take to ensure well behaved robots do not pick up his content. So your comment suggesting robots.txt is a good comment in its narrow frame, but one that missed the larger picture. That minor problem is solved. The interesting problem is of a different nature.

link