Hacker News new | ask | show | jobs
by WiSaGaN 999 days ago
I was actually expecting some comments regarding the 34B Llama 2 model. A quantized 34B model, such as Q5_K_M, might be the sweet spot for a moderate PC in terms of both speed and quality.