|
|
|
|
|
by scarface_74
1093 days ago
|
|
> People put stuff up on the Internet with the expectation of its consumption by human minds Then people obviously aren’t aware that bots have been indexing web pages and showing summarized information without going to the web page for
three decades. |
|
Further, almost every site has had an e.g. robots.txt which has permitted content harvesting only for certain accepted purposes for a couple decades now. So clearly people already had a sense of how they wanted their content harvested and for what purposes.