[newhaus1994]

Might be able to get 745M down to work on a single GPU. I'm definitely not using all 24GB, so fp16 might be able to get it down enough.

[sdan]

How would you use fp16 to get it to work on a single GPU? And if you did, what GPU should you use?