Hacker News new | ask | show | jobs
by zozbot234 31 days ago
GPU depreciation cycles are slowing down a lot. A big chunk of frontier model inference is still being run on Hopper-era GPUs because anything more recent is heavily bottlenecked and it makes more sense to use the newer stuff for training,