[Vuizur]

Decent local LLMs such as Vicuna-7B are already able to run on phones with 8 GB RAM: https://mlc.ai/mlc-llm/

Right now it's a prototype, but in the future local LLMs will be everywhere.

[bavell]

I really, really hope this is the case. Trying to be optimistic about this in spite of my skeptical nature :)