[ArbitraryLimits]

Where I come from, what you're describing is called pre-fetching, not caching. That's why your earlier comment confused me.

[scott_s]

No, I'm talking about caching: keeping data around that you have previously used, assuming you will use it again. However, in order to support caching, you must pre-allocate memory.