Hacker News new | ask | show | jobs
by uniqueuid 1464 days ago
Although memory capacity may matter more than speed for inference. As long as you're not training or fine tuning, the mac pro / studio may be just fine.

apart from the fact that you can't use any of the many nvidia-specific things; if you're dependent on cuda, nvcuvid, AMP or other things that's a hard no.

1 comments

What are the current best ML language models to play with on the M1Max?