| Thanks for the reply -- And I'm not trying to be difficult, but... I'm not convinced. In your scenario, the 500 comments are already loaded for any user. The comments you have authored are a small dataset, not a check for each and every comment. (At least, I HOPE not.) Similarly for your friends comments... and whether or not you are a mod is a single check. For the average thread and user, this really should be a handful of checks. Surely, there are some very active users with many friends for whom the checks could hit numbers in the 1000s. But that should be the edge case, shouldn't it? Same thing for loading a listing. Pulling subscriptions and merging sounds like just DB query design. All the "same things as we do for comments" should be minimized as described above. Rending a page is just that -- rendering... highly customized, yes. But customized on the previously discussed criteria, not a while new set of customizations. And like you said, if you aren't logged in, none of this applies. Which all begs two questions:
1) What percentage of users are logged in?
2) What percentage of page renders really fit the scenario you described above, with enough comments and related data points that the checks hit 4 digits? If you come back and say 90% of your page renders needs 1000 data points, I'd certainly concede the point. But I'd be very surprised. (And highly suggest that new algorithms are needed.) But I'm sincerely honest what those percentages are? |