Hacker News new | ask | show | jobs
by banderwidthdk 444 days ago
From my experience LLM inference really, really likes memory bandwidth, which at 1.79 TB/s the 5090 has quite the lead on the APU's 273GB/s