[moffkalast]

Just saying, Guanaco LLama model just got released that actually beats GPT-3.5 in a fair few metrics. So right now it's already possible to run a local version with a beefy GPU and it'll only get better as time goes on.

In a strange coincidence I've recently been doing some tests with small 10 W solar panels and with two or three of those plus an Nvidia Xavier (20 W TDP) one could actually run a solar powered LLM right now with only about as much solar as fits on a person's back (though only the smaller 13B versions).

Give it a few years and we'll have them integrated into smartphones. So yes, you will in fact always have an LLM in your pocket just like the ol' calculator excuse.

[gnicholas]

Good to know! I'd still be surprised if we had solar-powered AI assistants that are powered via ambient indoor lighting in the next few decades.

[moffkalast]

That I doubt, but then again we've come ridiculously far in the last 20 years and having AI assistants will only accelerate research further. If the singularity is really just 6 years out as some calculate, then anything and everything is possible afterwards. If you believe such things of course.

[BLKNSLVR]

If the Singularity is only 6 years out then that means fusion power must be only 10 years out.