[freehorse]

M3 was a weird generation, as they contained fewer transistors than the previous ones. It is slightly faster in single core tasks, and has a few more cores, but they are very close. But in terms of gpu, m3s are quite nerfed esp because they lowered the memory bandwidth, so on llm performance they are on par. I have both an m3 and an M1 Max, one of them from work, so I have tested them extensively (though the m3 is binned and 14”, the m1 full and 16”). M3 had better TTFT but the M1 had a bit higher tokens/s.

[neya]

Wow! Thanks for sharing. I didn't know this. Time to upgrade to M5? What do you think about the M5? I know it's too early for tests. But I would love to hear your opinion.

[freehorse]

M4 was already imo a more meaningful upgrade compared to m2/m3, and they increased the memory bandwidths too. But then, all apple silicon is good hardware, and I do not personally feel in any rush to upgrade, unless you want a specific upgrade like more ram.

[neya]

Thanks mate :)