Hacker News new | ask | show | jobs
by buckle8017 18 days ago
It's slower than the 4:1 ratio would imply, but it does indeed work.

Things get really slow if the model doesn't for in vram + ram and you have to go from disk to ram to vram.