|
|
|
|
|
|
by raxxorraxor
857 days ago
|
|
|
You are running the wrong model. Get a smaller one
Macs are usually ok with their performance since the GPU has access to main memory. A decent Nvidia GPU with lots of memory is still king though. I run codelama:7b on a MacBook air, and even auto complete is partially usable. |
|
|