[talldayo]

CUDA features unified memory that is only limited by the bandwidth of your PCIe connector: https://developer.nvidia.com/blog/unified-memory-cuda-beginn...

People have been tiling 24gb+ models on a single (or several) 3090/4090s for a while now.

[seec]

Shhh, don't correct the believers, they might learn something.