Hacker News new | ask | show | jobs
by muttled 898 days ago
I've got my fingers crossed on them cramming a lot of vRAM in there. They were putting 16gb in the Xeon Phi 7110P when 8GB was acceptable for system RAM in gaming machines. If they dropped a 64GB+ prosumer card, I'd be so happy. Even if it was something like 32GB of super-fast memory and another 64-128 of slightly slower-but-unified memory, I'd be ecstatic. Being able to fine-tune a 175B LLM locally would be incredible.