Hacker News new | ask | show | jobs
by himata4113 40 days ago
This is wrong because local models are very expensive, just as expensive as the frontier.

It would cost me $300 in normal deepseek v4 pricing (non discounted) PER DAY, but I get it all for $500 worth of subscriptions.

1 comments

Why are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own.
None of the models advanced enough to replace frontier will be able to run on your machine for any forseeable future or at a reasonable speed. 5tok/s is not acceptable.

To run deepseek v4 class model, you would need to spend $120k just in gpus.