[yamatokaneko]

I think it’s a very interesting approach. Could be for a niche group, likely power users of LLMs who are often mobile and value privacy.

Any thoughts on how small this hardware could eventually become?

[itstomo]

Looks like the hardware needed to run state-of-the-art open source LLM will be ~100kg... haha It's not feasible today. Someday!