[entropie]

I played around with a orin jetson nano super (a nvidia raspberry with gpu) and right now its basicially an open-webui with ollama and a bunch of models.

Its awesome actually. Its reasonably fast with GPU support with gemma3:4b but I can use bigger models when time is not a factor.

i've actually thought about how crazy that is, especially if there's no internet access for some reason. Not tested yet, but there seems to be an adapter cable to run it directly from a PD powerbank. I have to try.