[phendrenad2]

Google doesn't want to index the web, it wants to index what it can monetize. It is a business after all, and storage space costs money.

[cromwellian]

If that were true, they wouldn't index any long tail content at all. The reality is, predicting what is valuable is difficult, and the cost of storage is relatively cheap.

[xcql]

I don't see how that follows. It can also be a mixed calculation because people don't use a search engine that never displays any long tail content.