Hacker News new | ask | show | jobs
by russelg 43 days ago
I've got the same spec, are you running the 27B or the 35B-A3B? I found the 27B was unusably slow (like 10-15t/s not to mention the prefill times)