[nozzlegear]

Why are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own.

[himata4113]

None of the models advanced enough to replace frontier will be able to run on your machine for any forseeable future or at a reasonable speed. 5tok/s is not acceptable.

To run deepseek v4 class model, you would need to spend $120k just in gpus.