Hacker News new | ask | show | jobs
by maxdo 3 days ago
Why on earth I should switch from a top tier model to much worse local model ? Why do I need to suffer my battery ?
2 comments

You can switch to local models for tasks/use-cases where you don't need top tier models.
Right now there is no reason since tokens are subsidized heavily. However when OpenAI/Anthropic will drop the $200/month pricing since most likely it eventually will become unsustainable you'd rather get MacBook Pro M6 Ultra with 128GB ram and go local then pay thousands every month for tokens.