[The_rationalist]

You could technically dynamically offload the RAM overload to disk but this would probably be too slow?

[whimsicalism]

I mean, theoretically if you can get the model weights onto disk then you should be able to do the computation - but it might takes days or months on commodity hardware. It would also require creating a system that can do this and I doubt there is much demand.