[ggktk]

I'm predicting that the upcoming Mac Pro will be very popular among ML developers, thanks to unified memory. It should be able to fit the entire model in memory.

Combine that with the fact that PyTorch recently added support for Apple silicon GPUs.

[tehsauce]

upcoming mac pro will have pretty poor ML performance when compared to even an old nvidia gpu sadly.

[uniqueuid]

Although memory capacity may matter more than speed for inference. As long as you're not training or fine tuning, the mac pro / studio may be just fine.

apart from the fact that you can't use any of the many nvidia-specific things; if you're dependent on cuda, nvcuvid, AMP or other things that's a hard no.

[calrizien]

What are the current best ML language models to play with on the M1Max?