Hacker News new | ask | show | jobs
by m1sta_ 926 days ago
I run mistral on an M2 air and it's broadly similar to chatgpt.
1 comments

How? I have an M2 Pro and I run 7B and 13B models through Ollama and also LM Studio.

Because there’s no CUDA, the speed is much slower than ChatGPT. The answers from 7B are also not at the same quality as ChatGPT. (Lots of mistakes and hallucinations)

Is metal working?
Yes but it’s still no ChatGPT 4.