Hacker News new | ask | show | jobs
by gwern 2498 days ago
Ouch! So 11GB is nowhere close to being enough, then. I wonder if even switching to FP16 will be adequate?
1 comments
newhaus1994 2498 days ago
Might be able to get 745M down to work on a single GPU. I'm definitely not using all 24GB, so fp16 might be able to get it down enough.
link
sdan 2497 days ago
How would you use fp16 to get it to work on a single GPU? And if you did, what GPU should you use?
link