Hacker News new | ask | show | jobs
by zkmon 38 days ago
Not sure how much of your GLM is offloaded to CPU. I was contending the suggestion of using system RAM + VRAM.