Hacker News new | ask | show | jobs
by clusterhacks 33 days ago
Huh. Same problem, and I run with llama.cpp. In my case, Gemma4-31B (4-bit quant though) will just stop sometimes.