Hacker News new | ask | show | jobs
by Lacerda69 790 days ago
I run it fine on my 64gb RAM beast.
2 comments

At what quantization? 4-bit is 80GB. Less than 4-bit is rarely good enough at this point.
Is that normal ram of GPU ram?
64GB is not GPU RAM, but system RAM. Consumer GPUs have 24GB at most, those with good value/price have way less. Current generation workstation GPUs are unaffordable; used can be found on ebay for a reasonable price, but they are quite slow. DDR5 RAM might be a better investment.