Hacker News new | ask | show | jobs
by regularfry 29 days ago
Seems weird. A 9B model would normally fit unquantised on a 24GB GPU.