Hacker News new | ask | show | jobs
by romaaeterna 254 days ago
Running the first question as a test against mradermacher's GGUF of the 20b heretic fails when running llama.cpp as Q4_K_M, but successfully generates the tutorial with larger better quality Q8_0