[azinman2]

You’re being downvoted but it’s actually an interesting issue. Many companies (yelp) already have suffered from quick results… at a certain point Google will have a hive mind but little reason to have you go any further. This is good as a user (hypothetically), but does not contribute back at all to the producers of such information who may have additional value to unlock.

Meanwhile the Reddit’s and whatnots can’t afford to not have Google index them, so this is just the price of admission. I wonder if they need an expansion to do not crawl that lets you specify how the data could be used?