Hacker News new | ask | show | jobs
by YetAnotherNick 533 days ago
> Also, macOS devices are not very good inference solutions

They are good for single batch inference and have very good tok/sec/user. ollama works perfectly in mac.