Hacker News new | ask | show | jobs
by romaaeterna 208 days ago
Running the first question as a test against mradermacher's GGUF of the 20b heretic fails when running llama.cpp as Q4_K_M, but successfully generates the tutorial with larger better quality Q8_0