Hacker News new | ask | show | jobs
by wenc 926 days ago
How? I have an M2 Pro and I run 7B and 13B models through Ollama and also LM Studio.

Because there’s no CUDA, the speed is much slower than ChatGPT. The answers from 7B are also not at the same quality as ChatGPT. (Lots of mistakes and hallucinations)

1 comments

Is metal working?
Yes but it’s still no ChatGPT 4.