|
|
|
|
|
|
by TimByte
4 days ago
|
|
|
The whole point of Apple silicon isnt speed, it is capacity. You can grab a Mac Studio with 192 gb of unified memory and shove a model in there that would otherwise require building a rig with multiple rtx 4090 s. For local dev just being able to fit the weights in memory is often way more important than token generation speed |
|
|