[charcircuit]

>That prices would rise

Competition will prevent that from happening. When anyone can host open models and there is giant demand for LLMs companies can not easily raise token prices without sending a lot of traffic to their competitors.

[paganel]

> When anyone can host open models

They'd still need to pay the actual power costs.

[charcircuit]

I didn't say that inference would be free, but that everything to do inference is a commodity which means that competition is easy to do.