[Barathkanna]

Local models solve the marginal cost problem, but they move the complexity into infrastructure and throughput planning instead.

[clearloop]

makes sense, it really depends on the use cases, I'm building my version of claw openwalrus for the local LLMs first goal, I think myself will use local models for daily tasks that heavily depend on tool callings, but for coding or doing research, I'll keep using remote models

and this topic actually inspires me that I can introduce a builtin gas meter for tokens