[natch]

Well, no. You have to read further up the thread to see the issue I was referring to.

>I wonder if our current discussion boards on the interwebs can survive the coming influx of content like this and the next generations of it that follow.

Yes the robots.txt is a good and trivial step he could take to ensure well behaved robots do not pick up his content. So your comment suggesting robots.txt is a good comment in its narrow frame, but one that missed the larger picture. That minor problem is solved. The interesting problem is of a different nature.