[pcwalton]

Yeah, it's one of the two hard problems in computer science after all :)

In practice LRU caches work pretty well.