|
|
|
|
|
|
by __mharrison__
103 days ago
|
|
|
Were you using mlx-lm? I've had good performance with that on Macs. (Sadly, the lead developer just left Apple.) Admittedly, I haven't tried these models on my Mac, but I have on my DGX Spark, and they ran fine. I didn't see the slowdown you're mentioning. |
|
|