Hacker News new | ask | show | jobs
by platevoltage 45 days ago
Fantastic. I run local models too. This was specifically about APIs
1 comments

Why do you think costs will go up when the competition is increasing while hardware prices per compute cycle go down? That's the part I don't get.
Going from a fixed monthly fee to a per token billing structure is not a cost reduction, and we are watching that happen in real time.