Hacker News new | ask | show | jobs
by lightoverhead 593 days ago
The machine is great! How is its performance for AI model training? A lot of library and tools are not built for M series chip
1 comments

Poor. My M3 Max/128GB is about 20x slower than 4090. For inference it's much better, still much slower than 4090 but it enables working with much larger LLMs albeit at ~10t/s (in comparison, Threadripper 2990WX/256GB does like 0.25t/s). M4 Max is likely going to be ~25% faster than M3 Max based on CPU perf and memory bandwidth.