|
|
|
|
|
|
by daniel-thompson
1125 days ago
|
|
|
> Local LLMs do best on big GPUs, which aren’t an option on Macs. For processing speed, Ms are fast but I agree not anywhere near a top Nvdia chip. For memory size, the memory on an M chip can be used as graphics memory, so a person could get an M2 today with 128GB of graphics memory for ~ $5k. Not bad considering an Nvidia chip approaching that memory size is several times that much. |
|
|