Hacker News new | ask | show | jobs
by behohippy 488 days ago
I run the KV cache at Q8 even on that model. Is it not working well for you?