[trumpdong]

We might even decide to put 32GB of high-latency cache on the system board and then 12GB of throughput-optimized main memory close to the GPU. ;)

[marcosdumay]

You meant a 128GB (instead of 12GB)?

And yes, a L4 cache can be one way out of that problem. Another way is making the L3 cache lines wider and working the hell out of improving your management algorithm.

It's not a theoretically impossible problem. It's also not something you can solve automatically with a bit more money or some simple decisions. It's possible this is the best architecture available, but it's not certain by any means.

[trumpdong]

I mean 12GB, an amount that is typical in such a system today, which you can buy at any computer store.

[saagarjha]

Yeah but unfortunately I hear trying to get more than that is quite hard

[marcosdumay]

Oh, I entirely misunderstood your comment :)