[otabdeveloper4]

> Not to mention the current token cost.

Games is one place where running local LLM's is a no-brainer.

[KronisLV]

With the advent of unoptimized UE5 releases becoming the norm and the mentality of shipping badly broken games by default and them only being in a good state years later if at all, I’m not sure running an LLM on device would be a good idea.