Hacker News new | ask | show | jobs
by chermi 32 days ago
Per frontier token. You're not calculating the cost of a fixed quality asset here. Old hw running non-frontier models will be very valuable. In fact, we have two direct examples: older server gpus actually appreciating and the very obvious fact that not everyone always use MAX FULL EFFORT BEST MODEL no matter what.
1 comments

Not consumer hw ... and if we speak about local llm we cannot assume most of us can put a rack in their basement

Already today is not possible to run deep seek v4 pro locally, and I cannot imagine that in 2 years we will be.