[cschmid]

I don't think replacing a workstation with a Macbook because of RAM makes too much sense: If running one minibatch of your model already takes up all the memory you have, where would the rest of your training data sit? In the M1, you don't have a separate main memory.

Also, software support for accelerated training on Apple hardware is extremely limited: Out of the main frameworks, only tensorflow seems to target it, and even there, the issues you'll face won't be high on the priority list.

I know that nvidia GPUs are very expensive, but if you're really serious about training a large model, the only alternative would be paying rent to Google.

[m15i]

Good points. I look forward to some benchmarks. Just hoping for an alternative to Nvidia sooner than later. Dreaming apple will solve it and offer a 1.5 TB mac pro.